2026-02-17T11:07:40.819 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T11:07:40.833 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T11:07:40.909 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51269 branch: wip-bharath19-testing-2026-02-13-0903-squid description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '51269' kernel: branch: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: trial name: skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-bharath19-testing-2026-02-13-0903-squid ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e workunit: branch: wip-bharath19-testing-2026-02-13-0903-squid sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 3603 sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath19-testing-2026-02-13-0903-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e targets: trial148.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBItvPl2DkuirEIA3Bb9wVd96TiiyOw+csnH2K7jRuyMMPS7RcqZekgeQ6ug/QQGPnXQKd4WSpVTis3hRbcW6PJ0= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - osd teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_04:03:08 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T11:07:40.909 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa; will attempt to use it 2026-02-17T11:07:40.910 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks 2026-02-17T11:07:40.910 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T11:07:40.911 INFO:teuthology.task.internal:Checking packages... 2026-02-17T11:07:40.912 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e' 2026-02-17T11:07:40.912 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T11:07:40.912 INFO:teuthology.packaging:ref: None 2026-02-17T11:07:40.912 INFO:teuthology.packaging:tag: None 2026-02-17T11:07:40.912 INFO:teuthology.packaging:branch: wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T11:07:40.912 INFO:teuthology.packaging:sha1: 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T11:07:40.912 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T11:07:41.036 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-705-g04cf6dd4-1jammy 2026-02-17T11:07:41.038 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T11:07:41.049 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T11:07:41.049 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T11:07:41.063 INFO:teuthology.task.internal:Saving configuration 2026-02-17T11:07:41.071 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T11:07:41.082 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T11:07:41.160 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial148.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51269', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 11:04:12.281976', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINb3GQ6nSAvKLuHlfbOtTUan9aKqbOtj8Z5/KJNRfPrn'} 2026-02-17T11:07:41.160 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T11:07:41.171 INFO:teuthology.task.internal:roles: ubuntu@trial148.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-17T11:07:41.171 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T11:07:41.262 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x772b1d3cf920>, signals=[15]) 2026-02-17T11:07:41.262 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T11:07:41.273 INFO:teuthology.task.internal:Opening connections... 2026-02-17T11:07:41.273 DEBUG:teuthology.task.internal:connecting to ubuntu@trial148.front.sepia.ceph.com 2026-02-17T11:07:41.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:07:41.338 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T11:07:41.350 DEBUG:teuthology.orchestra.run.trial148:> uname -m 2026-02-17T11:07:41.415 INFO:teuthology.orchestra.run.trial148.stdout:x86_64 2026-02-17T11:07:41.415 DEBUG:teuthology.orchestra.run.trial148:> cat /etc/os-release 2026-02-17T11:07:41.462 INFO:teuthology.orchestra.run.trial148.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-17T11:07:41.462 INFO:teuthology.orchestra.run.trial148.stdout:NAME="Ubuntu" 2026-02-17T11:07:41.462 INFO:teuthology.orchestra.run.trial148.stdout:VERSION_ID="22.04" 2026-02-17T11:07:41.462 INFO:teuthology.orchestra.run.trial148.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-17T11:07:41.462 INFO:teuthology.orchestra.run.trial148.stdout:VERSION_CODENAME=jammy 2026-02-17T11:07:41.462 INFO:teuthology.orchestra.run.trial148.stdout:ID=ubuntu 2026-02-17T11:07:41.462 INFO:teuthology.orchestra.run.trial148.stdout:ID_LIKE=debian 2026-02-17T11:07:41.462 INFO:teuthology.orchestra.run.trial148.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-17T11:07:41.462 INFO:teuthology.orchestra.run.trial148.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-17T11:07:41.463 INFO:teuthology.orchestra.run.trial148.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-17T11:07:41.463 INFO:teuthology.orchestra.run.trial148.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-17T11:07:41.463 INFO:teuthology.orchestra.run.trial148.stdout:UBUNTU_CODENAME=jammy 2026-02-17T11:07:41.463 INFO:teuthology.lock.ops:Updating trial148.front.sepia.ceph.com on lock server 2026-02-17T11:07:41.546 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T11:07:41.561 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T11:07:41.573 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T11:07:41.573 DEBUG:teuthology.orchestra.run.trial148:> test '!' -e /home/ubuntu/cephtest 2026-02-17T11:07:41.576 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T11:07:41.587 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T11:07:41.587 DEBUG:teuthology.orchestra.run.trial148:> test -z $(ls -A /var/lib/ceph) 2026-02-17T11:07:41.623 INFO:teuthology.orchestra.run.trial148.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-17T11:07:41.623 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T11:07:41.717 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T11:07:41.736 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T11:07:41.736 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T11:07:41.736 DEBUG:teuthology.orchestra.run.trial148:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T11:07:41.739 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:07:41.739 DEBUG:teuthology.orchestra.run.trial148:> uname -r 2026-02-17T11:07:41.785 INFO:teuthology.orchestra.run.trial148.stdout:5.15.0-164-generic 2026-02-17T11:07:41.786 INFO:teuthology.task.kernel:Running kernel on trial148: 5.15.0-164-generic 2026-02-17T11:07:41.786 DEBUG:teuthology.orchestra.run.trial148:> sudo apt-get clean 2026-02-17T11:07:41.843 DEBUG:teuthology.orchestra.run.trial148:> sudo apt-get update 2026-02-17T11:07:42.025 INFO:teuthology.orchestra.run.trial148.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T11:07:42.033 INFO:teuthology.orchestra.run.trial148.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-17T11:07:42.070 INFO:teuthology.orchestra.run.trial148.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-17T11:07:42.086 INFO:teuthology.orchestra.run.trial148.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-17T11:07:42.169 INFO:teuthology.orchestra.run.trial148.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3236 kB] 2026-02-17T11:07:42.229 INFO:teuthology.orchestra.run.trial148.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [493 kB] 2026-02-17T11:07:42.232 INFO:teuthology.orchestra.run.trial148.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-17T11:07:42.232 INFO:teuthology.orchestra.run.trial148.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1255 kB] 2026-02-17T11:07:42.240 INFO:teuthology.orchestra.run.trial148.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [313 kB] 2026-02-17T11:07:42.242 INFO:teuthology.orchestra.run.trial148.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-17T11:07:42.242 INFO:teuthology.orchestra.run.trial148.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5287 kB] 2026-02-17T11:07:42.269 INFO:teuthology.orchestra.run.trial148.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [997 kB] 2026-02-17T11:07:42.272 INFO:teuthology.orchestra.run.trial148.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2966 kB] 2026-02-17T11:07:42.282 INFO:teuthology.orchestra.run.trial148.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [426 kB] 2026-02-17T11:07:42.283 INFO:teuthology.orchestra.run.trial148.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-17T11:07:42.283 INFO:teuthology.orchestra.run.trial148.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-17T11:07:42.288 INFO:teuthology.orchestra.run.trial148.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [224 kB] 2026-02-17T11:07:42.288 INFO:teuthology.orchestra.run.trial148.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-17T11:07:42.289 INFO:teuthology.orchestra.run.trial148.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5096 kB] 2026-02-17T11:07:42.306 INFO:teuthology.orchestra.run.trial148.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [964 kB] 2026-02-17T11:07:46.074 INFO:teuthology.orchestra.run.trial148.stdout:Fetched 22.7 MB in 2s (13.4 MB/s) 2026-02-17T11:07:46.612 INFO:teuthology.orchestra.run.trial148.stdout:Reading package lists... 2026-02-17T11:07:46.626 DEBUG:teuthology.orchestra.run.trial148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T11:07:46.660 INFO:teuthology.orchestra.run.trial148.stdout:Reading package lists... 2026-02-17T11:07:46.770 INFO:teuthology.orchestra.run.trial148.stdout:Building dependency tree... 2026-02-17T11:07:46.771 INFO:teuthology.orchestra.run.trial148.stdout:Reading state information... 2026-02-17T11:07:46.859 INFO:teuthology.orchestra.run.trial148.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T11:07:46.859 INFO:teuthology.orchestra.run.trial148.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T11:07:46.859 INFO:teuthology.orchestra.run.trial148.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T11:07:46.859 INFO:teuthology.orchestra.run.trial148.stdout: sg3-utils-udev 2026-02-17T11:07:46.859 INFO:teuthology.orchestra.run.trial148.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T11:07:46.860 INFO:teuthology.orchestra.run.trial148.stdout:The following additional packages will be installed: 2026-02-17T11:07:46.860 INFO:teuthology.orchestra.run.trial148.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T11:07:46.860 INFO:teuthology.orchestra.run.trial148.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-17T11:07:46.860 INFO:teuthology.orchestra.run.trial148.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-17T11:07:46.860 INFO:teuthology.orchestra.run.trial148.stdout:Suggested packages: 2026-02-17T11:07:46.860 INFO:teuthology.orchestra.run.trial148.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-17T11:07:46.873 INFO:teuthology.orchestra.run.trial148.stdout:The following NEW packages will be installed: 2026-02-17T11:07:46.873 INFO:teuthology.orchestra.run.trial148.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-17T11:07:46.874 INFO:teuthology.orchestra.run.trial148.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-17T11:07:46.874 INFO:teuthology.orchestra.run.trial148.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-17T11:07:46.875 INFO:teuthology.orchestra.run.trial148.stdout:The following packages will be upgraded: 2026-02-17T11:07:46.875 INFO:teuthology.orchestra.run.trial148.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-17T11:07:46.979 INFO:teuthology.orchestra.run.trial148.stdout:3 upgraded, 5 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T11:07:46.979 INFO:teuthology.orchestra.run.trial148.stdout:Need to get 113 MB of archives. 2026-02-17T11:07:46.979 INFO:teuthology.orchestra.run.trial148.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-17T11:07:46.979 INFO:teuthology.orchestra.run.trial148.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-17T11:07:47.149 INFO:teuthology.orchestra.run.trial148.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-17T11:07:47.193 INFO:teuthology.orchestra.run.trial148.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-17T11:07:47.435 INFO:teuthology.orchestra.run.trial148.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-17T11:07:47.435 INFO:teuthology.orchestra.run.trial148.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-17T11:07:47.435 INFO:teuthology.orchestra.run.trial148.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-17T11:07:47.484 INFO:teuthology.orchestra.run.trial148.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-17T11:07:47.495 INFO:teuthology.orchestra.run.trial148.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-17T11:07:47.693 INFO:teuthology.orchestra.run.trial148.stdout:Fetched 113 MB in 1s (183 MB/s) 2026-02-17T11:07:47.713 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-17T11:07:47.878 INFO:teuthology.orchestra.run.trial148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-17T11:07:47.880 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T11:07:47.881 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:07:48.234 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-17T11:07:48.240 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T11:07:48.263 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:07:48.301 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-17T11:07:48.308 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T11:07:48.308 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:07:49.407 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T11:07:49.408 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T11:07:49.430 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T11:07:49.431 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T11:07:49.448 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-17T11:07:49.455 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-17T11:07:49.455 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T11:07:50.823 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-17T11:07:50.835 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-17T11:07:50.835 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:07:51.427 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-17T11:07:51.428 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-17T11:07:51.453 INFO:teuthology.orchestra.run.trial148.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-17T11:07:51.454 INFO:teuthology.orchestra.run.trial148.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:07:51.455 INFO:teuthology.orchestra.run.trial148.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-17T11:07:51.457 INFO:teuthology.orchestra.run.trial148.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:07:52.232 INFO:teuthology.orchestra.run.trial148.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:07:53.050 INFO:teuthology.orchestra.run.trial148.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-17T11:07:53.050 INFO:teuthology.orchestra.run.trial148.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-17T11:07:53.056 INFO:teuthology.orchestra.run.trial148.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:07:53.850 INFO:teuthology.orchestra.run.trial148.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-17T11:07:53.851 INFO:teuthology.orchestra.run.trial148.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-17T11:07:53.853 INFO:teuthology.orchestra.run.trial148.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-17T11:07:53.858 INFO:teuthology.orchestra.run.trial148.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-17T11:07:53.858 INFO:teuthology.orchestra.run.trial148.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-17T11:08:00.902 INFO:teuthology.orchestra.run.trial148.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-17T11:08:07.566 INFO:teuthology.orchestra.run.trial148.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-17T11:08:07.567 INFO:teuthology.orchestra.run.trial148.stdout:Sourcing file `/etc/default/grub' 2026-02-17T11:08:07.586 INFO:teuthology.orchestra.run.trial148.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T11:08:07.587 INFO:teuthology.orchestra.run.trial148.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T11:08:07.589 INFO:teuthology.orchestra.run.trial148.stdout:Generating grub configuration file ... 2026-02-17T11:08:07.668 INFO:teuthology.orchestra.run.trial148.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T11:08:07.675 INFO:teuthology.orchestra.run.trial148.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T11:08:07.850 INFO:teuthology.orchestra.run.trial148.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T11:08:07.855 INFO:teuthology.orchestra.run.trial148.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T11:08:07.929 INFO:teuthology.orchestra.run.trial148.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T11:08:07.929 INFO:teuthology.orchestra.run.trial148.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T11:08:07.929 INFO:teuthology.orchestra.run.trial148.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T11:08:07.932 INFO:teuthology.orchestra.run.trial148.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T11:08:07.941 INFO:teuthology.orchestra.run.trial148.stdout:done 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout: 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout:Pending kernel upgrade! 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout: 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout:Running kernel version: 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout: 5.15.0-164-generic 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout: 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout:Diagnostics: 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout: 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout: 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout:The processor microcode seems to be up-to-date. 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout: 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout:No services need to be restarted. 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout: 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout:No containers need to be restarted. 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout: 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout:No user sessions are running outdated binaries. 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout: 2026-02-17T11:08:08.360 INFO:teuthology.orchestra.run.trial148.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T11:08:09.022 DEBUG:teuthology.orchestra.run.trial148:> dpkg -s linux-image-generic 2026-02-17T11:08:09.073 INFO:teuthology.orchestra.run.trial148.stdout:Package: linux-image-generic 2026-02-17T11:08:09.073 INFO:teuthology.orchestra.run.trial148.stdout:Status: install ok installed 2026-02-17T11:08:09.073 INFO:teuthology.orchestra.run.trial148.stdout:Priority: optional 2026-02-17T11:08:09.073 INFO:teuthology.orchestra.run.trial148.stdout:Section: kernel 2026-02-17T11:08:09.073 INFO:teuthology.orchestra.run.trial148.stdout:Installed-Size: 21 2026-02-17T11:08:09.073 INFO:teuthology.orchestra.run.trial148.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T11:08:09.073 INFO:teuthology.orchestra.run.trial148.stdout:Architecture: amd64 2026-02-17T11:08:09.074 INFO:teuthology.orchestra.run.trial148.stdout:Source: linux-meta 2026-02-17T11:08:09.074 INFO:teuthology.orchestra.run.trial148.stdout:Version: 5.15.0.170.159 2026-02-17T11:08:09.074 INFO:teuthology.orchestra.run.trial148.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T11:08:09.074 INFO:teuthology.orchestra.run.trial148.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T11:08:09.074 INFO:teuthology.orchestra.run.trial148.stdout:Recommends: thermald 2026-02-17T11:08:09.074 INFO:teuthology.orchestra.run.trial148.stdout:Description: Generic Linux kernel image 2026-02-17T11:08:09.074 INFO:teuthology.orchestra.run.trial148.stdout: This package will always depend on the latest generic kernel image 2026-02-17T11:08:09.074 INFO:teuthology.orchestra.run.trial148.stdout: available. 2026-02-17T11:08:09.075 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-17T11:08:09.075 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T11:08:09.076 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T11:08:09.076 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-17T11:08:09.076 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial148.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T11:08:09.076 DEBUG:teuthology.orchestra.run.trial148:> sudo apt-get clean 2026-02-17T11:08:09.155 DEBUG:teuthology.orchestra.run.trial148:> sudo apt-get update 2026-02-17T11:08:09.652 INFO:teuthology.orchestra.run.trial148.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T11:08:09.734 INFO:teuthology.orchestra.run.trial148.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T11:08:09.824 INFO:teuthology.orchestra.run.trial148.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T11:08:09.913 INFO:teuthology.orchestra.run.trial148.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T11:08:10.566 INFO:teuthology.orchestra.run.trial148.stdout:Reading package lists... 2026-02-17T11:08:10.581 DEBUG:teuthology.orchestra.run.trial148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-17T11:08:10.613 INFO:teuthology.orchestra.run.trial148.stdout:Reading package lists... 2026-02-17T11:08:10.723 INFO:teuthology.orchestra.run.trial148.stdout:Building dependency tree... 2026-02-17T11:08:10.724 INFO:teuthology.orchestra.run.trial148.stdout:Reading state information... 2026-02-17T11:08:10.809 INFO:teuthology.orchestra.run.trial148.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-17T11:08:10.809 INFO:teuthology.orchestra.run.trial148.stdout:linux-image-generic set to manually installed. 2026-02-17T11:08:10.809 INFO:teuthology.orchestra.run.trial148.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T11:08:10.809 INFO:teuthology.orchestra.run.trial148.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T11:08:10.810 INFO:teuthology.orchestra.run.trial148.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T11:08:10.810 INFO:teuthology.orchestra.run.trial148.stdout: sg3-utils-udev 2026-02-17T11:08:10.810 INFO:teuthology.orchestra.run.trial148.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T11:08:10.829 INFO:teuthology.orchestra.run.trial148.stdout:0 upgraded, 0 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T11:08:10.831 DEBUG:teuthology.orchestra.run.trial148:> dpkg -s linux-image-generic 2026-02-17T11:08:10.880 INFO:teuthology.orchestra.run.trial148.stdout:Package: linux-image-generic 2026-02-17T11:08:10.880 INFO:teuthology.orchestra.run.trial148.stdout:Status: install ok installed 2026-02-17T11:08:10.880 INFO:teuthology.orchestra.run.trial148.stdout:Priority: optional 2026-02-17T11:08:10.880 INFO:teuthology.orchestra.run.trial148.stdout:Section: kernel 2026-02-17T11:08:10.880 INFO:teuthology.orchestra.run.trial148.stdout:Installed-Size: 21 2026-02-17T11:08:10.880 INFO:teuthology.orchestra.run.trial148.stdout:Maintainer: Ubuntu Kernel Team 2026-02-17T11:08:10.880 INFO:teuthology.orchestra.run.trial148.stdout:Architecture: amd64 2026-02-17T11:08:10.881 INFO:teuthology.orchestra.run.trial148.stdout:Source: linux-meta 2026-02-17T11:08:10.881 INFO:teuthology.orchestra.run.trial148.stdout:Version: 5.15.0.170.159 2026-02-17T11:08:10.881 INFO:teuthology.orchestra.run.trial148.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-17T11:08:10.881 INFO:teuthology.orchestra.run.trial148.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-17T11:08:10.881 INFO:teuthology.orchestra.run.trial148.stdout:Recommends: thermald 2026-02-17T11:08:10.881 INFO:teuthology.orchestra.run.trial148.stdout:Description: Generic Linux kernel image 2026-02-17T11:08:10.881 INFO:teuthology.orchestra.run.trial148.stdout: This package will always depend on the latest generic kernel image 2026-02-17T11:08:10.881 INFO:teuthology.orchestra.run.trial148.stdout: available. 2026-02-17T11:08:10.882 DEBUG:teuthology.orchestra.run.trial148:> mktemp 2026-02-17T11:08:10.927 INFO:teuthology.orchestra.run.trial148.stdout:/tmp/tmp.mLfRx6FmJV 2026-02-17T11:08:10.928 DEBUG:teuthology.orchestra.run.trial148:> sudo cp /boot/grub/grub.cfg /tmp/tmp.mLfRx6FmJV 2026-02-17T11:08:10.980 DEBUG:teuthology.orchestra.run.trial148:> sudo chmod 0666 /tmp/tmp.mLfRx6FmJV 2026-02-17T11:08:11.077 DEBUG:teuthology.orchestra.remote:trial148:/tmp/tmp.mLfRx6FmJV is 7KB 2026-02-17T11:08:11.086 DEBUG:teuthology.orchestra.run.trial148:> rm -fr /tmp/tmp.mLfRx6FmJV 2026-02-17T11:08:11.090 DEBUG:teuthology.orchestra.run.trial148:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-17T11:08:11.143 DEBUG:teuthology.orchestra.run.trial148:> set -ex 2026-02-17T11:08:11.143 DEBUG:teuthology.orchestra.run.trial148:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-17T11:08:11.143 DEBUG:teuthology.orchestra.run.trial148:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-17T11:08:11.201 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-17T11:08:11.202 DEBUG:teuthology.orchestra.run.trial148:> sudo update-grub 2026-02-17T11:08:11.428 INFO:teuthology.orchestra.run.trial148.stderr:Sourcing file `/etc/default/grub' 2026-02-17T11:08:11.448 INFO:teuthology.orchestra.run.trial148.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-17T11:08:11.449 INFO:teuthology.orchestra.run.trial148.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-17T11:08:11.451 INFO:teuthology.orchestra.run.trial148.stderr:Generating grub configuration file ... 2026-02-17T11:08:11.532 INFO:teuthology.orchestra.run.trial148.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-17T11:08:11.538 INFO:teuthology.orchestra.run.trial148.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-17T11:08:11.707 INFO:teuthology.orchestra.run.trial148.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-17T11:08:11.712 INFO:teuthology.orchestra.run.trial148.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-17T11:08:11.781 INFO:teuthology.orchestra.run.trial148.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-17T11:08:11.781 INFO:teuthology.orchestra.run.trial148.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-17T11:08:11.781 INFO:teuthology.orchestra.run.trial148.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-17T11:08:11.783 INFO:teuthology.orchestra.run.trial148.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T11:08:11.791 INFO:teuthology.orchestra.run.trial148.stderr:done 2026-02-17T11:08:11.792 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial148 2026-02-17T11:08:11.793 DEBUG:teuthology.orchestra.run.trial148:> sudo bash -c ' 2026-02-17T11:08:11.793 DEBUG:teuthology.orchestra.run.trial148:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T11:08:11.793 DEBUG:teuthology.orchestra.run.trial148:> ' 2026-02-17T11:08:41.795 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-17T11:08:41.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial148.front.sepia.ceph.com' 2026-02-17T11:08:41.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:09:41.858 DEBUG:teuthology.orchestra.remote:timed out 2026-02-17T11:09:50.867 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial148.front.sepia.ceph.com' 2026-02-17T11:09:50.868 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:09:50.993 DEBUG:teuthology.orchestra.run.trial148:> true 2026-02-17T11:09:51.388 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial148.front.sepia.ceph.com' 2026-02-17T11:09:51.388 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-170-generic"... 2026-02-17T11:09:51.388 DEBUG:teuthology.orchestra.run.trial148:> uname -r 2026-02-17T11:09:51.433 INFO:teuthology.orchestra.run.trial148.stdout:5.15.0-170-generic 2026-02-17T11:09:51.434 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-17T11:09:51.434 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T11:09:51.434 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-17T11:09:52.435 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-17T11:09:52.435 DEBUG:teuthology.orchestra.run.trial148:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T11:09:52.448 INFO:teuthology.orchestra.run.trial148.stdout:ttyS1 2026-02-17T11:09:52.468 DEBUG:teuthology.parallel:result is None 2026-02-17T11:09:52.469 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T11:09:52.480 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T11:09:52.481 DEBUG:teuthology.orchestra.run.trial148:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T11:09:52.514 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T11:09:52.526 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T11:09:52.540 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T11:09:52.541 DEBUG:teuthology.orchestra.run.trial148:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T11:09:52.568 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T11:09:52.580 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T11:09:52.580 DEBUG:teuthology.orchestra.run.trial148:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T11:09:52.614 INFO:teuthology.orchestra.run.trial148.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:09:52.621 INFO:teuthology.orchestra.run.trial148.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:09:52.622 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T11:09:52.634 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T11:09:52.635 DEBUG:teuthology.orchestra.run.trial148:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T11:09:52.674 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T11:09:52.690 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T11:09:52.690 DEBUG:teuthology.orchestra.run.trial148:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T11:09:52.721 DEBUG:teuthology.orchestra.run.trial148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:09:52.765 DEBUG:teuthology.orchestra.run.trial148:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:09:52.810 DEBUG:teuthology.orchestra.run.trial148:> set -ex 2026-02-17T11:09:52.810 DEBUG:teuthology.orchestra.run.trial148:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T11:09:52.863 DEBUG:teuthology.orchestra.run.trial148:> sudo service rsyslog restart 2026-02-17T11:09:52.922 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T11:09:52.936 INFO:teuthology.task.internal:Starting timer... 2026-02-17T11:09:52.936 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T11:09:52.957 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T11:09:52.976 DEBUG:teuthology.task.selinux:Excluding trial148: OS 'ubuntu' does not support SELinux 2026-02-17T11:09:52.976 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T11:09:52.976 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-17T11:09:52.976 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T11:09:52.976 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T11:09:52.990 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T11:09:53.001 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T11:09:53.003 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial148.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T11:12:21.311 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial148.front.sepia.ceph.com')] 2026-02-17T11:12:21.318 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial148.front.sepia.ceph.com' 2026-02-17T11:12:21.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial148.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T11:12:21.433 DEBUG:teuthology.orchestra.run.trial148:> true 2026-02-17T11:12:21.682 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial148.front.sepia.ceph.com' 2026-02-17T11:12:21.682 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T11:12:21.728 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T11:12:21.728 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T11:12:21.729 DEBUG:teuthology.orchestra.run.trial148:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:12:21.746 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-17T11:12:21.746 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: Command line: ntpd -gq 2026-02-17T11:12:21.746 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: ---------------------------------------------------- 2026-02-17T11:12:21.746 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: ntp-4 is maintained by Network Time Foundation, 2026-02-17T11:12:21.746 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-17T11:12:21.746 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: corporation. Support and training for ntp-4 are 2026-02-17T11:12:21.746 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: available at https://www.nwtime.org/support 2026-02-17T11:12:21.747 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: ---------------------------------------------------- 2026-02-17T11:12:21.747 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: proto: precision = 0.020 usec (-25) 2026-02-17T11:12:21.747 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: basedate set to 2022-02-04 2026-02-17T11:12:21.747 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: gps base set to 2022-02-06 (week 2196) 2026-02-17T11:12:21.747 INFO:teuthology.orchestra.run.trial148.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T11:12:21.747 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-17T11:12:21.747 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: restrict ::: KOD does nothing without LIMITED. 2026-02-17T11:12:21.747 INFO:teuthology.orchestra.run.trial148.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-17T11:12:21.748 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: Listen and drop on 0 v6wildcard [::]:123 2026-02-17T11:12:21.748 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-17T11:12:21.748 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: Listen normally on 2 lo 127.0.0.1:123 2026-02-17T11:12:21.748 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: Listen normally on 3 enp1s0f0 10.20.193.148:123 2026-02-17T11:12:21.748 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: Listen normally on 4 lo [::1]:123 2026-02-17T11:12:21.748 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:64b4%2]:123 2026-02-17T11:12:21.748 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:21 ntpd[8791]: Listening on routing socket on fd #22 for interface updates 2026-02-17T11:12:22.746 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:22 ntpd[8791]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:12:22.747 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:22 ntpd[8791]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:12:22.747 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:22 ntpd[8791]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:12:22.747 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:22 ntpd[8791]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:12:22.934 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:22 ntpd[8791]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:12:22.935 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:22 ntpd[8791]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:12:22.935 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:22 ntpd[8791]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T11:12:22.935 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:22 ntpd[8791]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T11:12:23.747 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:23 ntpd[8791]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:12:23.747 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:23 ntpd[8791]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:12:23.766 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:23 ntpd[8791]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:12:23.766 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:23 ntpd[8791]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:12:23.766 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:23 ntpd[8791]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T11:12:23.766 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:23 ntpd[8791]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T11:12:24.747 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:24 ntpd[8791]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:12:24.747 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:24 ntpd[8791]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:12:24.934 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:24 ntpd[8791]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:12:24.935 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:24 ntpd[8791]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:12:24.935 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:24 ntpd[8791]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T11:12:24.935 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:24 ntpd[8791]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T11:12:25.747 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:25 ntpd[8791]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:12:25.747 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:25 ntpd[8791]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:12:25.766 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:25 ntpd[8791]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:12:25.766 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:25 ntpd[8791]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:12:25.766 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:25 ntpd[8791]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T11:12:25.766 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:25 ntpd[8791]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T11:12:26.747 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:26 ntpd[8791]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:12:26.747 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:26 ntpd[8791]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:12:26.747 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:26 ntpd[8791]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:12:26.748 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:26 ntpd[8791]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:12:26.774 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:26 ntpd[8791]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:12:26.774 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:26 ntpd[8791]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:12:26.774 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:26 ntpd[8791]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T11:12:26.774 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:26 ntpd[8791]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T11:12:26.934 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:26 ntpd[8791]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:12:26.935 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:26 ntpd[8791]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:12:26.935 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:26 ntpd[8791]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T11:12:26.935 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:26 ntpd[8791]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T11:12:27.747 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:27 ntpd[8791]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:12:27.747 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:27 ntpd[8791]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:12:27.766 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:27 ntpd[8791]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:12:27.766 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:27 ntpd[8791]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:12:27.766 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:27 ntpd[8791]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T11:12:27.766 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:27 ntpd[8791]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T11:12:28.747 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:28 ntpd[8791]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:12:28.747 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:28 ntpd[8791]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:12:28.748 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:28 ntpd[8791]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:12:28.748 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:28 ntpd[8791]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:12:28.774 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:28 ntpd[8791]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:12:28.774 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:28 ntpd[8791]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:12:28.774 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:28 ntpd[8791]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T11:12:28.774 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:28 ntpd[8791]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T11:12:28.934 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:28 ntpd[8791]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-17T11:12:28.935 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:28 ntpd[8791]: can't open /var/log/ntpstats/rawstats.20260217: Permission denied 2026-02-17T11:12:28.935 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:28 ntpd[8791]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-17T11:12:28.935 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:28 ntpd[8791]: can't open /var/log/ntpstats/peerstats.20260217: Permission denied 2026-02-17T11:12:28.935 INFO:teuthology.orchestra.run.trial148.stdout:17 Feb 11:12:28 ntpd[8791]: ntpd: time set +0.543039 s 2026-02-17T11:12:28.935 INFO:teuthology.orchestra.run.trial148.stdout:ntpd: time set +0.543039s 2026-02-17T11:12:28.936 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:28 ntpd[8791]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-17T11:12:28.936 INFO:teuthology.orchestra.run.trial148.stderr:17 Feb 11:12:28 ntpd[8791]: can't open /var/log/ntpstats/loopstats.20260217: Permission denied 2026-02-17T11:12:29.156 INFO:teuthology.orchestra.run.trial148.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T11:12:29.156 INFO:teuthology.orchestra.run.trial148.stdout:============================================================================== 2026-02-17T11:12:29.156 INFO:teuthology.orchestra.run.trial148.stdout: ntp2.zeus.frume .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T11:12:29.156 INFO:teuthology.orchestra.run.trial148.stdout: 192-155-94-72.i .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T11:12:29.156 INFO:teuthology.orchestra.run.trial148.stdout: 149.28.61.105 ( .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T11:12:29.156 INFO:teuthology.orchestra.run.trial148.stdout: 69-10-208-170.r .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-17T11:12:29.158 INFO:teuthology.run_tasks:Running task install... 2026-02-17T11:12:29.172 DEBUG:teuthology.task.install:project ceph 2026-02-17T11:12:29.172 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'}} 2026-02-17T11:12:29.172 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'} 2026-02-17T11:12:29.172 INFO:teuthology.task.install:Using flavor: default 2026-02-17T11:12:29.180 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T11:12:29.181 INFO:teuthology.task.install:extra packages: [] 2026-02-17T11:12:29.181 DEBUG:teuthology.orchestra.run.trial148:> sudo apt-key list | grep Ceph 2026-02-17T11:12:29.246 INFO:teuthology.orchestra.run.trial148.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-17T11:12:29.274 INFO:teuthology.orchestra.run.trial148.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-17T11:12:29.275 INFO:teuthology.orchestra.run.trial148.stdout:uid [ unknown] Ceph.com (release key) 2026-02-17T11:12:29.276 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-17T11:12:29.276 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T11:12:29.442 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default/ 2026-02-17T11:12:29.443 INFO:teuthology.task.install.deb:Package version is 19.2.3-705-g04cf6dd4-1jammy 2026-02-17T11:12:29.581 DEBUG:teuthology.orchestra.run.trial148:> set -ex 2026-02-17T11:12:29.581 DEBUG:teuthology.orchestra.run.trial148:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-17T11:12:29.591 DEBUG:teuthology.orchestra.run.trial148:> sudo apt-get update 2026-02-17T11:12:29.738 INFO:teuthology.orchestra.run.trial148.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy InRelease 2026-02-17T11:12:29.749 INFO:teuthology.orchestra.run.trial148.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy Release [7662 B] 2026-02-17T11:12:29.761 INFO:teuthology.orchestra.run.trial148.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-17T11:12:29.772 INFO:teuthology.orchestra.run.trial148.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2026-02-17T11:12:30.024 INFO:teuthology.orchestra.run.trial148.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-17T11:12:30.092 INFO:teuthology.orchestra.run.trial148.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-17T11:12:30.161 INFO:teuthology.orchestra.run.trial148.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-17T11:12:30.234 INFO:teuthology.orchestra.run.trial148.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-17T11:12:30.376 INFO:teuthology.orchestra.run.trial148.stdout:Fetched 25.8 kB in 1s (41.5 kB/s) 2026-02-17T11:12:30.912 INFO:teuthology.orchestra.run.trial148.stdout:Reading package lists... 2026-02-17T11:12:30.926 DEBUG:teuthology.orchestra.run.trial148:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.2.3-705-g04cf6dd4-1jammy cephadm=19.2.3-705-g04cf6dd4-1jammy ceph-mds=19.2.3-705-g04cf6dd4-1jammy ceph-mgr=19.2.3-705-g04cf6dd4-1jammy ceph-common=19.2.3-705-g04cf6dd4-1jammy ceph-fuse=19.2.3-705-g04cf6dd4-1jammy ceph-test=19.2.3-705-g04cf6dd4-1jammy ceph-volume=19.2.3-705-g04cf6dd4-1jammy radosgw=19.2.3-705-g04cf6dd4-1jammy python3-rados=19.2.3-705-g04cf6dd4-1jammy python3-rgw=19.2.3-705-g04cf6dd4-1jammy python3-cephfs=19.2.3-705-g04cf6dd4-1jammy python3-rbd=19.2.3-705-g04cf6dd4-1jammy libcephfs2=19.2.3-705-g04cf6dd4-1jammy libcephfs-dev=19.2.3-705-g04cf6dd4-1jammy librados2=19.2.3-705-g04cf6dd4-1jammy librbd1=19.2.3-705-g04cf6dd4-1jammy rbd-fuse=19.2.3-705-g04cf6dd4-1jammy 2026-02-17T11:12:30.960 INFO:teuthology.orchestra.run.trial148.stdout:Reading package lists... 2026-02-17T11:12:31.074 INFO:teuthology.orchestra.run.trial148.stdout:Building dependency tree... 2026-02-17T11:12:31.074 INFO:teuthology.orchestra.run.trial148.stdout:Reading state information... 2026-02-17T11:12:31.166 INFO:teuthology.orchestra.run.trial148.stdout:The following packages were automatically installed and are no longer required: 2026-02-17T11:12:31.167 INFO:teuthology.orchestra.run.trial148.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-17T11:12:31.167 INFO:teuthology.orchestra.run.trial148.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-17T11:12:31.167 INFO:teuthology.orchestra.run.trial148.stdout: sg3-utils-udev 2026-02-17T11:12:31.167 INFO:teuthology.orchestra.run.trial148.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-17T11:12:31.167 INFO:teuthology.orchestra.run.trial148.stdout:The following additional packages will be installed: 2026-02-17T11:12:31.167 INFO:teuthology.orchestra.run.trial148.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-17T11:12:31.167 INFO:teuthology.orchestra.run.trial148.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-17T11:12:31.167 INFO:teuthology.orchestra.run.trial148.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 2026-02-17T11:12:31.167 INFO:teuthology.orchestra.run.trial148.stdout: liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2026-02-17T11:12:31.167 INFO:teuthology.orchestra.run.trial148.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2026-02-17T11:12:31.167 INFO:teuthology.orchestra.run.trial148.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2026-02-17T11:12:31.168 INFO:teuthology.orchestra.run.trial148.stdout: pkg-config python-asyncssh-doc python-pastedeploy-tpl python3-asyncssh 2026-02-17T11:12:31.168 INFO:teuthology.orchestra.run.trial148.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cheroot 2026-02-17T11:12:31.168 INFO:teuthology.orchestra.run.trial148.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-17T11:12:31.168 INFO:teuthology.orchestra.run.trial148.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-17T11:12:31.168 INFO:teuthology.orchestra.run.trial148.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-17T11:12:31.168 INFO:teuthology.orchestra.run.trial148.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-17T11:12:31.168 INFO:teuthology.orchestra.run.trial148.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-17T11:12:31.168 INFO:teuthology.orchestra.run.trial148.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-17T11:12:31.168 INFO:teuthology.orchestra.run.trial148.stdout: python3-pyinotify python3-pytest python3-repoze.lru 2026-02-17T11:12:31.168 INFO:teuthology.orchestra.run.trial148.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2026-02-17T11:12:31.168 INFO:teuthology.orchestra.run.trial148.stdout: python3-simplejson python3-singledispatch python3-sklearn 2026-02-17T11:12:31.168 INFO:teuthology.orchestra.run.trial148.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2026-02-17T11:12:31.168 INFO:teuthology.orchestra.run.trial148.stdout: python3-toml python3-waitress python3-wcwidth python3-webob 2026-02-17T11:12:31.169 INFO:teuthology.orchestra.run.trial148.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2026-02-17T11:12:31.169 INFO:teuthology.orchestra.run.trial148.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2026-02-17T11:12:31.169 INFO:teuthology.orchestra.run.trial148.stdout:Suggested packages: 2026-02-17T11:12:31.169 INFO:teuthology.orchestra.run.trial148.stdout: python3-influxdb readline-doc python3-beaker python-mako-doc 2026-02-17T11:12:31.169 INFO:teuthology.orchestra.run.trial148.stdout: python-natsort-doc httpd-wsgi libapache2-mod-python libapache2-mod-scgi 2026-02-17T11:12:31.169 INFO:teuthology.orchestra.run.trial148.stdout: libjs-mochikit python-pecan-doc python-psutil-doc subversion 2026-02-17T11:12:31.169 INFO:teuthology.orchestra.run.trial148.stdout: python-pygments-doc ttf-bitstream-vera python-pyinotify-doc python3-dap 2026-02-17T11:12:31.169 INFO:teuthology.orchestra.run.trial148.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2026-02-17T11:12:31.169 INFO:teuthology.orchestra.run.trial148.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2026-02-17T11:12:31.169 INFO:teuthology.orchestra.run.trial148.stdout:Recommended packages: 2026-02-17T11:12:31.169 INFO:teuthology.orchestra.run.trial148.stdout: btrfs-tools 2026-02-17T11:12:31.201 INFO:teuthology.orchestra.run.trial148.stdout:The following NEW packages will be installed: 2026-02-17T11:12:31.201 INFO:teuthology.orchestra.run.trial148.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-17T11:12:31.201 INFO:teuthology.orchestra.run.trial148.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-17T11:12:31.201 INFO:teuthology.orchestra.run.trial148.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-17T11:12:31.201 INFO:teuthology.orchestra.run.trial148.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 2026-02-17T11:12:31.201 INFO:teuthology.orchestra.run.trial148.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-17T11:12:31.201 INFO:teuthology.orchestra.run.trial148.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2026-02-17T11:12:31.202 INFO:teuthology.orchestra.run.trial148.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2026-02-17T11:12:31.203 INFO:teuthology.orchestra.run.trial148.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2026-02-17T11:12:31.203 INFO:teuthology.orchestra.run.trial148.stdout: python-pastedeploy-tpl python3-asyncssh python3-cachetools 2026-02-17T11:12:31.203 INFO:teuthology.orchestra.run.trial148.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cheroot 2026-02-17T11:12:31.203 INFO:teuthology.orchestra.run.trial148.stdout: python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-17T11:12:31.203 INFO:teuthology.orchestra.run.trial148.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-17T11:12:31.203 INFO:teuthology.orchestra.run.trial148.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-logutils 2026-02-17T11:12:31.203 INFO:teuthology.orchestra.run.trial148.stdout: python3-mako python3-natsort python3-paste python3-pastedeploy 2026-02-17T11:12:31.203 INFO:teuthology.orchestra.run.trial148.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2026-02-17T11:12:31.203 INFO:teuthology.orchestra.run.trial148.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-17T11:12:31.203 INFO:teuthology.orchestra.run.trial148.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2026-02-17T11:12:31.203 INFO:teuthology.orchestra.run.trial148.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2026-02-17T11:12:31.203 INFO:teuthology.orchestra.run.trial148.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2026-02-17T11:12:31.204 INFO:teuthology.orchestra.run.trial148.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2026-02-17T11:12:31.204 INFO:teuthology.orchestra.run.trial148.stdout: python3-threadpoolctl python3-toml python3-waitress python3-wcwidth 2026-02-17T11:12:31.204 INFO:teuthology.orchestra.run.trial148.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2026-02-17T11:12:31.204 INFO:teuthology.orchestra.run.trial148.stdout: python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse socat unzip 2026-02-17T11:12:31.204 INFO:teuthology.orchestra.run.trial148.stdout: xmlstarlet zip 2026-02-17T11:12:31.308 INFO:teuthology.orchestra.run.trial148.stdout:0 upgraded, 108 newly installed, 0 to remove and 51 not upgraded. 2026-02-17T11:12:31.309 INFO:teuthology.orchestra.run.trial148.stdout:Need to get 178 MB of archives. 2026-02-17T11:12:31.309 INFO:teuthology.orchestra.run.trial148.stdout:After this operation, 809 MB of additional disk space will be used. 2026-02-17T11:12:31.309 INFO:teuthology.orchestra.run.trial148.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-17T11:12:31.354 INFO:teuthology.orchestra.run.trial148.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-17T11:12:31.355 INFO:teuthology.orchestra.run.trial148.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-17T11:12:31.364 INFO:teuthology.orchestra.run.trial148.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-17T11:12:31.392 INFO:teuthology.orchestra.run.trial148.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-17T11:12:31.394 INFO:teuthology.orchestra.run.trial148.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-17T11:12:31.399 INFO:teuthology.orchestra.run.trial148.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-17T11:12:31.401 INFO:teuthology.orchestra.run.trial148.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-17T11:12:31.402 INFO:teuthology.orchestra.run.trial148.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-17T11:12:31.403 INFO:teuthology.orchestra.run.trial148.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-17T11:12:31.403 INFO:teuthology.orchestra.run.trial148.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-17T11:12:31.408 INFO:teuthology.orchestra.run.trial148.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2026-02-17T11:12:31.409 INFO:teuthology.orchestra.run.trial148.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2026-02-17T11:12:31.410 INFO:teuthology.orchestra.run.trial148.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2026-02-17T11:12:31.413 INFO:teuthology.orchestra.run.trial148.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5034 B] 2026-02-17T11:12:31.414 INFO:teuthology.orchestra.run.trial148.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2026-02-17T11:12:31.415 INFO:teuthology.orchestra.run.trial148.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2026-02-17T11:12:31.417 INFO:teuthology.orchestra.run.trial148.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2026-02-17T11:12:31.423 INFO:teuthology.orchestra.run.trial148.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-17T11:12:31.423 INFO:teuthology.orchestra.run.trial148.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-17T11:12:31.424 INFO:teuthology.orchestra.run.trial148.stdout:Get:21 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-17T11:12:31.424 INFO:teuthology.orchestra.run.trial148.stdout:Get:22 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-17T11:12:31.425 INFO:teuthology.orchestra.run.trial148.stdout:Get:23 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-17T11:12:31.425 INFO:teuthology.orchestra.run.trial148.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-17T11:12:31.433 INFO:teuthology.orchestra.run.trial148.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-17T11:12:31.433 INFO:teuthology.orchestra.run.trial148.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-17T11:12:31.433 INFO:teuthology.orchestra.run.trial148.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-17T11:12:31.434 INFO:teuthology.orchestra.run.trial148.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-17T11:12:31.442 INFO:teuthology.orchestra.run.trial148.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-17T11:12:31.443 INFO:teuthology.orchestra.run.trial148.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2026-02-17T11:12:31.443 INFO:teuthology.orchestra.run.trial148.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2026-02-17T11:12:31.444 INFO:teuthology.orchestra.run.trial148.stdout:Get:32 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2026-02-17T11:12:31.444 INFO:teuthology.orchestra.run.trial148.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7320 B] 2026-02-17T11:12:31.445 INFO:teuthology.orchestra.run.trial148.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-17T11:12:31.452 INFO:teuthology.orchestra.run.trial148.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-waitress all 1.4.4-1.1ubuntu1.1 [47.0 kB] 2026-02-17T11:12:31.454 INFO:teuthology.orchestra.run.trial148.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2026-02-17T11:12:31.454 INFO:teuthology.orchestra.run.trial148.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2026-02-17T11:12:31.456 INFO:teuthology.orchestra.run.trial148.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4892 B] 2026-02-17T11:12:31.462 INFO:teuthology.orchestra.run.trial148.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2026-02-17T11:12:31.462 INFO:teuthology.orchestra.run.trial148.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2026-02-17T11:12:31.462 INFO:teuthology.orchestra.run.trial148.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2026-02-17T11:12:31.463 INFO:teuthology.orchestra.run.trial148.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.3 [181 kB] 2026-02-17T11:12:31.465 INFO:teuthology.orchestra.run.trial148.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-17T11:12:31.466 INFO:teuthology.orchestra.run.trial148.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-17T11:12:31.471 INFO:teuthology.orchestra.run.trial148.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-17T11:12:31.472 INFO:teuthology.orchestra.run.trial148.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-17T11:12:31.473 INFO:teuthology.orchestra.run.trial148.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-17T11:12:31.473 INFO:teuthology.orchestra.run.trial148.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.2.3-705-g04cf6dd4-1jammy [3593 kB] 2026-02-17T11:12:31.487 INFO:teuthology.orchestra.run.trial148.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-17T11:12:31.488 INFO:teuthology.orchestra.run.trial148.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-17T11:12:31.489 INFO:teuthology.orchestra.run.trial148.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-17T11:12:31.497 INFO:teuthology.orchestra.run.trial148.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-17T11:12:31.498 INFO:teuthology.orchestra.run.trial148.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-17T11:12:31.498 INFO:teuthology.orchestra.run.trial148.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-17T11:12:31.499 INFO:teuthology.orchestra.run.trial148.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-17T11:12:31.499 INFO:teuthology.orchestra.run.trial148.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-17T11:12:31.499 INFO:teuthology.orchestra.run.trial148.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-17T11:12:31.500 INFO:teuthology.orchestra.run.trial148.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-17T11:12:31.501 INFO:teuthology.orchestra.run.trial148.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-17T11:12:31.502 INFO:teuthology.orchestra.run.trial148.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-17T11:12:31.510 INFO:teuthology.orchestra.run.trial148.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-17T11:12:31.512 INFO:teuthology.orchestra.run.trial148.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-17T11:12:31.513 INFO:teuthology.orchestra.run.trial148.stdout:Get:63 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2026-02-17T11:12:31.513 INFO:teuthology.orchestra.run.trial148.stdout:Get:64 https://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2026-02-17T11:12:31.514 INFO:teuthology.orchestra.run.trial148.stdout:Get:65 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-17T11:12:31.516 INFO:teuthology.orchestra.run.trial148.stdout:Get:66 https://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2026-02-17T11:12:31.516 INFO:teuthology.orchestra.run.trial148.stdout:Get:67 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-17T11:12:31.519 INFO:teuthology.orchestra.run.trial148.stdout:Get:68 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-17T11:12:31.520 INFO:teuthology.orchestra.run.trial148.stdout:Get:69 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2026-02-17T11:12:31.520 INFO:teuthology.orchestra.run.trial148.stdout:Get:70 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-17T11:12:31.529 INFO:teuthology.orchestra.run.trial148.stdout:Get:71 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-17T11:12:31.530 INFO:teuthology.orchestra.run.trial148.stdout:Get:72 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-17T11:12:31.531 INFO:teuthology.orchestra.run.trial148.stdout:Get:73 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-17T11:12:31.534 INFO:teuthology.orchestra.run.trial148.stdout:Get:74 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2026-02-17T11:12:31.534 INFO:teuthology.orchestra.run.trial148.stdout:Get:75 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-17T11:12:31.534 INFO:teuthology.orchestra.run.trial148.stdout:Get:76 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-17T11:12:31.535 INFO:teuthology.orchestra.run.trial148.stdout:Get:77 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-17T11:12:31.539 INFO:teuthology.orchestra.run.trial148.stdout:Get:78 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-17T11:12:31.932 INFO:teuthology.orchestra.run.trial148.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.2.3-705-g04cf6dd4-1jammy [3257 kB] 2026-02-17T11:12:32.085 INFO:teuthology.orchestra.run.trial148.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.2.3-705-g04cf6dd4-1jammy [979 kB] 2026-02-17T11:12:32.111 INFO:teuthology.orchestra.run.trial148.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.2.3-705-g04cf6dd4-1jammy [357 kB] 2026-02-17T11:12:32.116 INFO:teuthology.orchestra.run.trial148.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.2.3-705-g04cf6dd4-1jammy [32.9 kB] 2026-02-17T11:12:32.117 INFO:teuthology.orchestra.run.trial148.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.2.3-705-g04cf6dd4-1jammy [184 kB] 2026-02-17T11:12:32.134 INFO:teuthology.orchestra.run.trial148.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.2.3-705-g04cf6dd4-1jammy [74.1 kB] 2026-02-17T11:12:32.136 INFO:teuthology.orchestra.run.trial148.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.2.3-705-g04cf6dd4-1jammy [337 kB] 2026-02-17T11:12:32.156 INFO:teuthology.orchestra.run.trial148.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.2.3-705-g04cf6dd4-1jammy [6935 kB] 2026-02-17T11:12:32.423 INFO:teuthology.orchestra.run.trial148.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.2.3-705-g04cf6dd4-1jammy [112 kB] 2026-02-17T11:12:32.448 INFO:teuthology.orchestra.run.trial148.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.2.3-705-g04cf6dd4-1jammy [470 kB] 2026-02-17T11:12:32.470 INFO:teuthology.orchestra.run.trial148.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.2.3-705-g04cf6dd4-1jammy [26.5 MB] 2026-02-17T11:12:33.431 INFO:teuthology.orchestra.run.trial148.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.2.3-705-g04cf6dd4-1jammy [5178 kB] 2026-02-17T11:12:33.517 INFO:teuthology.orchestra.run.trial148.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.2.3-705-g04cf6dd4-1jammy [248 kB] 2026-02-17T11:12:33.521 INFO:teuthology.orchestra.run.trial148.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.2.3-705-g04cf6dd4-1jammy [125 kB] 2026-02-17T11:12:33.522 INFO:teuthology.orchestra.run.trial148.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.2.3-705-g04cf6dd4-1jammy [1081 kB] 2026-02-17T11:12:33.540 INFO:teuthology.orchestra.run.trial148.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.2.3-705-g04cf6dd4-1jammy [6239 kB] 2026-02-17T11:12:33.643 INFO:teuthology.orchestra.run.trial148.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.2.3-705-g04cf6dd4-1jammy [23.0 MB] 2026-02-17T11:12:34.022 INFO:teuthology.orchestra.run.trial148.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.2.3-705-g04cf6dd4-1jammy [14.2 kB] 2026-02-17T11:12:34.022 INFO:teuthology.orchestra.run.trial148.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.2.3-705-g04cf6dd4-1jammy [1173 kB] 2026-02-17T11:12:34.038 INFO:teuthology.orchestra.run.trial148.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.2.3-705-g04cf6dd4-1jammy [2503 kB] 2026-02-17T11:12:34.079 INFO:teuthology.orchestra.run.trial148.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.2.3-705-g04cf6dd4-1jammy [798 kB] 2026-02-17T11:12:34.091 INFO:teuthology.orchestra.run.trial148.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.2.3-705-g04cf6dd4-1jammy [157 kB] 2026-02-17T11:12:34.094 INFO:teuthology.orchestra.run.trial148.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.2.3-705-g04cf6dd4-1jammy [2396 kB] 2026-02-17T11:12:34.134 INFO:teuthology.orchestra.run.trial148.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.2.3-705-g04cf6dd4-1jammy [8625 kB] 2026-02-17T11:12:34.276 INFO:teuthology.orchestra.run.trial148.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.2.3-705-g04cf6dd4-1jammy [14.3 kB] 2026-02-17T11:12:34.276 INFO:teuthology.orchestra.run.trial148.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.2.3-705-g04cf6dd4-1jammy [52.1 MB] 2026-02-17T11:12:35.137 INFO:teuthology.orchestra.run.trial148.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.2.3-705-g04cf6dd4-1jammy [135 kB] 2026-02-17T11:12:35.137 INFO:teuthology.orchestra.run.trial148.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.2.3-705-g04cf6dd4-1jammy [41.0 kB] 2026-02-17T11:12:35.138 INFO:teuthology.orchestra.run.trial148.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.2.3-705-g04cf6dd4-1jammy [13.7 MB] 2026-02-17T11:12:35.357 INFO:teuthology.orchestra.run.trial148.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-bharath19-testing-2026-02-13-0903-squid/04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.2.3-705-g04cf6dd4-1jammy [92.1 kB] 2026-02-17T11:12:35.677 INFO:teuthology.orchestra.run.trial148.stdout:Fetched 178 MB in 4s (42.8 MB/s) 2026-02-17T11:12:35.694 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-17T11:12:35.853 INFO:teuthology.orchestra.run.trial148.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-17T11:12:35.855 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-17T11:12:35.856 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T11:12:35.878 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-17T11:12:35.890 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-17T11:12:35.890 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T11:12:35.905 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-17T11:12:35.917 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-17T11:12:35.918 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T11:12:35.936 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-17T11:12:35.947 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T11:12:35.953 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T11:12:35.989 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-17T11:12:36.001 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T11:12:36.002 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T11:12:36.018 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-17T11:12:36.028 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-17T11:12:36.029 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T11:12:36.048 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-17T11:12:36.057 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-17T11:12:36.057 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T11:12:36.073 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package librados2. 2026-02-17T11:12:36.080 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../007-librados2_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:36.081 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking librados2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:36.122 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package libnbd0. 2026-02-17T11:12:36.131 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2026-02-17T11:12:36.131 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-17T11:12:36.145 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package librbd1. 2026-02-17T11:12:36.153 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../009-librbd1_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:36.154 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking librbd1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:36.196 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package libcephfs2. 2026-02-17T11:12:36.205 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../010-libcephfs2_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:36.205 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking libcephfs2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:36.226 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-rados. 2026-02-17T11:12:36.234 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../011-python3-rados_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:36.234 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-rados (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:36.251 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-17T11:12:36.260 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T11:12:36.260 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-ceph-argparse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:36.275 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-cephfs. 2026-02-17T11:12:36.283 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../013-python3-cephfs_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:36.283 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-cephfs (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:36.299 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-17T11:12:36.307 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../014-python3-ceph-common_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T11:12:36.308 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:36.325 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-17T11:12:36.333 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-17T11:12:36.333 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T11:12:36.349 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-prettytable. 2026-02-17T11:12:36.357 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2026-02-17T11:12:36.357 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-17T11:12:36.372 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-rbd. 2026-02-17T11:12:36.380 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../017-python3-rbd_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:36.380 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-rbd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:36.397 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-17T11:12:36.406 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-17T11:12:36.406 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T11:12:36.424 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package libreadline-dev:amd64. 2026-02-17T11:12:36.432 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2026-02-17T11:12:36.433 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2026-02-17T11:12:36.450 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2026-02-17T11:12:36.458 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2026-02-17T11:12:36.459 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-17T11:12:36.476 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package lua5.1. 2026-02-17T11:12:36.484 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2026-02-17T11:12:36.484 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2026-02-17T11:12:36.503 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package lua-any. 2026-02-17T11:12:36.511 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2026-02-17T11:12:36.512 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking lua-any (27ubuntu1) ... 2026-02-17T11:12:36.525 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package zip. 2026-02-17T11:12:36.533 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2026-02-17T11:12:36.534 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking zip (3.0-12build2) ... 2026-02-17T11:12:36.550 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package unzip. 2026-02-17T11:12:36.558 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2026-02-17T11:12:36.559 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2026-02-17T11:12:36.578 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package luarocks. 2026-02-17T11:12:36.586 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2026-02-17T11:12:36.586 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2026-02-17T11:12:36.624 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package librgw2. 2026-02-17T11:12:36.632 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../026-librgw2_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:36.633 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking librgw2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:36.706 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-rgw. 2026-02-17T11:12:36.714 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../027-python3-rgw_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:36.715 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-rgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:36.730 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-17T11:12:36.738 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../028-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-17T11:12:36.738 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T11:12:36.752 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package libradosstriper1. 2026-02-17T11:12:36.761 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../029-libradosstriper1_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:36.762 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking libradosstriper1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:36.780 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package ceph-common. 2026-02-17T11:12:36.788 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../030-ceph-common_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:36.788 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:36.989 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package ceph-base. 2026-02-17T11:12:36.997 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../031-ceph-base_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:37.002 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking ceph-base (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:37.065 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-17T11:12:37.074 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-17T11:12:37.075 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-17T11:12:37.088 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-cheroot. 2026-02-17T11:12:37.097 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-17T11:12:37.097 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T11:12:37.114 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-17T11:12:37.123 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-17T11:12:37.123 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-17T11:12:37.138 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-17T11:12:37.147 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-17T11:12:37.147 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-17T11:12:37.161 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-17T11:12:37.169 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-17T11:12:37.170 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-17T11:12:37.184 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-tempora. 2026-02-17T11:12:37.192 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2026-02-17T11:12:37.193 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-17T11:12:37.207 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-portend. 2026-02-17T11:12:37.215 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2026-02-17T11:12:37.216 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-17T11:12:37.230 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-17T11:12:37.239 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-17T11:12:37.239 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-17T11:12:37.253 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-17T11:12:37.262 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-17T11:12:37.262 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-17T11:12:37.285 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-natsort. 2026-02-17T11:12:37.293 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2026-02-17T11:12:37.294 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-17T11:12:37.309 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-logutils. 2026-02-17T11:12:37.317 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2026-02-17T11:12:37.317 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-logutils (0.3.3-8) ... 2026-02-17T11:12:37.332 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-mako. 2026-02-17T11:12:37.341 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2026-02-17T11:12:37.341 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-17T11:12:37.359 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-simplegeneric. 2026-02-17T11:12:37.367 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2026-02-17T11:12:37.367 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2026-02-17T11:12:37.382 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-singledispatch. 2026-02-17T11:12:37.390 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2026-02-17T11:12:37.391 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2026-02-17T11:12:37.404 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-webob. 2026-02-17T11:12:37.412 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-17T11:12:37.413 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T11:12:37.430 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-waitress. 2026-02-17T11:12:37.437 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1.1_all.deb ... 2026-02-17T11:12:37.440 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-17T11:12:37.455 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-tempita. 2026-02-17T11:12:37.463 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2026-02-17T11:12:37.464 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2026-02-17T11:12:37.478 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-paste. 2026-02-17T11:12:37.487 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2026-02-17T11:12:37.487 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2026-02-17T11:12:37.515 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2026-02-17T11:12:37.523 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2026-02-17T11:12:37.523 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2026-02-17T11:12:37.538 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-pastedeploy. 2026-02-17T11:12:37.546 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2026-02-17T11:12:37.547 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2026-02-17T11:12:37.561 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-webtest. 2026-02-17T11:12:37.570 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2026-02-17T11:12:37.570 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-webtest (2.0.35-1) ... 2026-02-17T11:12:37.586 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-pecan. 2026-02-17T11:12:37.594 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2026-02-17T11:12:37.595 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2026-02-17T11:12:37.619 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-werkzeug. 2026-02-17T11:12:37.627 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.3_all.deb ... 2026-02-17T11:12:37.628 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-17T11:12:37.647 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-17T11:12:37.655 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T11:12:37.655 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking ceph-mgr-modules-core (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:37.684 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-17T11:12:37.692 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:37.693 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking libsqlite3-mod-ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:37.708 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package ceph-mgr. 2026-02-17T11:12:37.716 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../057-ceph-mgr_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:37.717 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking ceph-mgr (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:37.739 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package ceph-mon. 2026-02-17T11:12:37.747 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../058-ceph-mon_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:37.748 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking ceph-mon (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:37.805 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-17T11:12:37.813 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../059-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-17T11:12:37.814 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T11:12:37.830 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package ceph-osd. 2026-02-17T11:12:37.838 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../060-ceph-osd_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:37.838 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking ceph-osd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:37.990 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package ceph. 2026-02-17T11:12:37.999 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../061-ceph_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:37.999 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:38.013 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package ceph-fuse. 2026-02-17T11:12:38.021 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../062-ceph-fuse_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:38.022 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking ceph-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:38.045 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package ceph-mds. 2026-02-17T11:12:38.053 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../063-ceph-mds_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:38.054 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking ceph-mds (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:38.087 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package cephadm. 2026-02-17T11:12:38.095 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../064-cephadm_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:38.096 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:38.111 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-17T11:12:38.120 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T11:12:38.120 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T11:12:38.141 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-17T11:12:38.150 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../066-ceph-mgr-cephadm_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T11:12:38.150 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking ceph-mgr-cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:38.170 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-17T11:12:38.179 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../067-python3-repoze.lru_0.7-2_all.deb ... 2026-02-17T11:12:38.179 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-17T11:12:38.194 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-routes. 2026-02-17T11:12:38.203 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../068-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-17T11:12:38.203 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T11:12:38.222 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-17T11:12:38.230 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../069-ceph-mgr-dashboard_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T11:12:38.231 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking ceph-mgr-dashboard (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:38.439 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-17T11:12:38.448 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-17T11:12:38.448 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T11:12:38.487 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-joblib. 2026-02-17T11:12:38.496 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../071-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-17T11:12:38.496 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T11:12:38.523 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-17T11:12:38.532 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../072-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-17T11:12:38.533 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-17T11:12:38.548 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-sklearn. 2026-02-17T11:12:38.557 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../073-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-17T11:12:38.557 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T11:12:38.640 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-17T11:12:38.650 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../074-ceph-mgr-diskprediction-local_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T11:12:38.650 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking ceph-mgr-diskprediction-local (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:38.815 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-cachetools. 2026-02-17T11:12:38.824 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../075-python3-cachetools_5.0.0-1_all.deb ... 2026-02-17T11:12:38.824 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-17T11:12:38.839 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-rsa. 2026-02-17T11:12:38.848 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../076-python3-rsa_4.8-1_all.deb ... 2026-02-17T11:12:38.848 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-17T11:12:38.865 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-google-auth. 2026-02-17T11:12:38.873 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-3_all.deb ... 2026-02-17T11:12:38.874 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-17T11:12:38.891 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-17T11:12:38.899 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../078-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-17T11:12:38.899 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T11:12:38.915 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-websocket. 2026-02-17T11:12:38.924 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../079-python3-websocket_1.2.3-1_all.deb ... 2026-02-17T11:12:38.924 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-17T11:12:38.941 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-17T11:12:38.950 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../080-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-17T11:12:38.950 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T11:12:39.045 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-17T11:12:39.054 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../081-ceph-mgr-k8sevents_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T11:12:39.055 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking ceph-mgr-k8sevents (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:39.069 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-17T11:12:39.077 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../082-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-17T11:12:39.084 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T11:12:39.101 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-17T11:12:39.109 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../083-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T11:12:39.109 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T11:12:39.124 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package jq. 2026-02-17T11:12:39.133 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../084-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-17T11:12:39.133 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-17T11:12:39.147 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package socat. 2026-02-17T11:12:39.155 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../085-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-17T11:12:39.156 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-17T11:12:39.177 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package xmlstarlet. 2026-02-17T11:12:39.185 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../086-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-17T11:12:39.185 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-17T11:12:39.220 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package ceph-test. 2026-02-17T11:12:39.229 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../087-ceph-test_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:39.229 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking ceph-test (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:39.707 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package ceph-volume. 2026-02-17T11:12:39.716 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../088-ceph-volume_19.2.3-705-g04cf6dd4-1jammy_all.deb ... 2026-02-17T11:12:39.716 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking ceph-volume (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:39.739 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-17T11:12:39.747 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../089-libcephfs-dev_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:39.747 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking libcephfs-dev (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:39.763 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package lua-socket:amd64. 2026-02-17T11:12:39.772 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../090-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2026-02-17T11:12:39.772 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-17T11:12:39.793 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package lua-sec:amd64. 2026-02-17T11:12:39.802 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../091-lua-sec_1.0.2-1_amd64.deb ... 2026-02-17T11:12:39.802 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2026-02-17T11:12:39.819 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package nvme-cli. 2026-02-17T11:12:39.828 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../092-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-17T11:12:39.829 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T11:12:39.858 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package pkg-config. 2026-02-17T11:12:39.866 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../093-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2026-02-17T11:12:39.867 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2026-02-17T11:12:39.883 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-17T11:12:39.891 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../094-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-17T11:12:39.891 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T11:12:39.921 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-17T11:12:39.930 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../095-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-17T11:12:39.930 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-17T11:12:39.944 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-pastescript. 2026-02-17T11:12:39.953 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../096-python3-pastescript_2.0.2-4_all.deb ... 2026-02-17T11:12:39.953 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2026-02-17T11:12:39.971 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-pluggy. 2026-02-17T11:12:39.980 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../097-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-17T11:12:39.980 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-17T11:12:39.996 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-psutil. 2026-02-17T11:12:40.004 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../098-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-17T11:12:40.004 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-17T11:12:40.023 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-py. 2026-02-17T11:12:40.032 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../099-python3-py_1.10.0-1_all.deb ... 2026-02-17T11:12:40.032 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-17T11:12:40.052 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-pygments. 2026-02-17T11:12:40.060 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../100-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-17T11:12:40.061 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T11:12:40.102 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-pyinotify. 2026-02-17T11:12:40.111 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../101-python3-pyinotify_0.9.6-1.3_all.deb ... 2026-02-17T11:12:40.111 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2026-02-17T11:12:40.126 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-toml. 2026-02-17T11:12:40.134 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../102-python3-toml_0.10.2-1_all.deb ... 2026-02-17T11:12:40.135 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-17T11:12:40.149 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-pytest. 2026-02-17T11:12:40.158 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../103-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-17T11:12:40.158 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T11:12:40.180 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package python3-simplejson. 2026-02-17T11:12:40.188 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../104-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-17T11:12:40.189 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-17T11:12:40.206 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-17T11:12:40.215 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../105-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-17T11:12:40.215 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-17T11:12:40.287 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package radosgw. 2026-02-17T11:12:40.296 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../106-radosgw_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:40.297 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking radosgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:40.410 INFO:teuthology.orchestra.run.trial148.stdout:Selecting previously unselected package rbd-fuse. 2026-02-17T11:12:40.419 INFO:teuthology.orchestra.run.trial148.stdout:Preparing to unpack .../107-rbd-fuse_19.2.3-705-g04cf6dd4-1jammy_amd64.deb ... 2026-02-17T11:12:40.419 INFO:teuthology.orchestra.run.trial148.stdout:Unpacking rbd-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:40.448 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-17T11:12:40.514 INFO:teuthology.orchestra.run.trial148.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-17T11:12:40.514 INFO:teuthology.orchestra.run.trial148.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-17T11:12:40.587 INFO:teuthology.orchestra.run.trial148.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T11:12:40.876 INFO:teuthology.orchestra.run.trial148.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-17T11:12:41.278 INFO:teuthology.orchestra.run.trial148.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-17T11:12:41.289 INFO:teuthology.orchestra.run.trial148.stdout:Setting up cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:41.330 INFO:teuthology.orchestra.run.trial148.stdout:Adding system user cephadm....done 2026-02-17T11:12:41.340 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1.1) ... 2026-02-17T11:12:41.411 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-17T11:12:41.484 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-17T11:12:41.485 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-17T11:12:41.557 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-17T11:12:41.632 INFO:teuthology.orchestra.run.trial148.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-17T11:12:41.633 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-17T11:12:41.728 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-17T11:12:41.850 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-17T11:12:41.926 INFO:teuthology.orchestra.run.trial148.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2026-02-17T11:12:41.936 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2026-02-17T11:12:42.012 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-17T11:12:42.086 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-ceph-argparse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:42.151 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-17T11:12:42.152 INFO:teuthology.orchestra.run.trial148.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-17T11:12:42.153 INFO:teuthology.orchestra.run.trial148.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2026-02-17T11:12:42.154 INFO:teuthology.orchestra.run.trial148.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2026-02-17T11:12:42.155 INFO:teuthology.orchestra.run.trial148.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-17T11:12:42.156 INFO:teuthology.orchestra.run.trial148.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2026-02-17T11:12:42.172 INFO:teuthology.orchestra.run.trial148.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2026-02-17T11:12:42.174 INFO:teuthology.orchestra.run.trial148.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2026-02-17T11:12:42.175 INFO:teuthology.orchestra.run.trial148.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-17T11:12:42.176 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-17T11:12:42.299 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-17T11:12:42.377 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-17T11:12:42.454 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-17T11:12:42.542 INFO:teuthology.orchestra.run.trial148.stdout:Setting up zip (3.0-12build2) ... 2026-02-17T11:12:42.543 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-17T11:12:42.791 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2026-02-17T11:12:42.868 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2026-02-17T11:12:42.869 INFO:teuthology.orchestra.run.trial148.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-17T11:12:42.870 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-17T11:12:42.962 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-17T11:12:43.086 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2026-02-17T11:12:43.213 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-17T11:12:43.293 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.3) ... 2026-02-17T11:12:43.399 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-17T11:12:43.473 INFO:teuthology.orchestra.run.trial148.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-17T11:12:43.474 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:43.558 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-17T11:12:44.055 INFO:teuthology.orchestra.run.trial148.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2026-02-17T11:12:44.077 INFO:teuthology.orchestra.run.trial148.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T11:12:44.081 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-17T11:12:44.157 INFO:teuthology.orchestra.run.trial148.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-17T11:12:44.158 INFO:teuthology.orchestra.run.trial148.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-17T11:12:44.159 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-17T11:12:44.235 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-17T11:12:44.309 INFO:teuthology.orchestra.run.trial148.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T11:12:44.310 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-17T11:12:44.387 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2026-02-17T11:12:44.461 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-logutils (0.3.3-8) ... 2026-02-17T11:12:44.536 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-17T11:12:44.610 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2026-02-17T11:12:44.684 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-17T11:12:44.763 INFO:teuthology.orchestra.run.trial148.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-17T11:12:44.764 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-17T11:12:44.848 INFO:teuthology.orchestra.run.trial148.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-17T11:12:44.849 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-17T11:12:44.925 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2026-02-17T11:12:45.002 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-17T11:12:45.087 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-17T11:12:45.161 INFO:teuthology.orchestra.run.trial148.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2026-02-17T11:12:45.162 INFO:teuthology.orchestra.run.trial148.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2026-02-17T11:12:45.163 INFO:teuthology.orchestra.run.trial148.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-17T11:12:45.164 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-17T11:12:45.303 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2026-02-17T11:12:45.380 INFO:teuthology.orchestra.run.trial148.stdout:Setting up lua-any (27ubuntu1) ... 2026-02-17T11:12:45.381 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-17T11:12:45.452 INFO:teuthology.orchestra.run.trial148.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-17T11:12:45.454 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-17T11:12:45.533 INFO:teuthology.orchestra.run.trial148.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-17T11:12:45.534 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-webtest (2.0.35-1) ... 2026-02-17T11:12:45.615 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-17T11:12:45.746 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-pastescript (2.0.2-4) ... 2026-02-17T11:12:45.842 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2026-02-17T11:12:45.957 INFO:teuthology.orchestra.run.trial148.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-17T11:12:45.958 INFO:teuthology.orchestra.run.trial148.stdout:Setting up librados2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:45.959 INFO:teuthology.orchestra.run.trial148.stdout:Setting up libsqlite3-mod-ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:45.960 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-17T11:12:46.477 INFO:teuthology.orchestra.run.trial148.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2026-02-17T11:12:46.488 INFO:teuthology.orchestra.run.trial148.stdout:Setting up libcephfs2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:46.489 INFO:teuthology.orchestra.run.trial148.stdout:Setting up libradosstriper1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:46.490 INFO:teuthology.orchestra.run.trial148.stdout:Setting up librbd1 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:46.491 INFO:teuthology.orchestra.run.trial148.stdout:Setting up ceph-mgr-modules-core (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:46.492 INFO:teuthology.orchestra.run.trial148.stdout:Setting up ceph-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:46.561 INFO:teuthology.orchestra.run.trial148.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T11:12:46.561 INFO:teuthology.orchestra.run.trial148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-17T11:12:46.965 INFO:teuthology.orchestra.run.trial148.stdout:Setting up libcephfs-dev (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:46.966 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-rados (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:46.967 INFO:teuthology.orchestra.run.trial148.stdout:Setting up librgw2 (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:46.968 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-rbd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:46.969 INFO:teuthology.orchestra.run.trial148.stdout:Setting up rbd-fuse (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:46.970 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-rgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:46.971 INFO:teuthology.orchestra.run.trial148.stdout:Setting up python3-cephfs (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:46.971 INFO:teuthology.orchestra.run.trial148.stdout:Setting up ceph-common (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:46.999 INFO:teuthology.orchestra.run.trial148.stdout:Adding group ceph....done 2026-02-17T11:12:47.034 INFO:teuthology.orchestra.run.trial148.stdout:Adding system user ceph....done 2026-02-17T11:12:47.044 INFO:teuthology.orchestra.run.trial148.stdout:Setting system user ceph properties....done 2026-02-17T11:12:47.050 INFO:teuthology.orchestra.run.trial148.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-17T11:12:47.138 INFO:teuthology.orchestra.run.trial148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-17T11:12:47.419 INFO:teuthology.orchestra.run.trial148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-17T11:12:47.819 INFO:teuthology.orchestra.run.trial148.stdout:Setting up ceph-test (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:47.820 INFO:teuthology.orchestra.run.trial148.stdout:Setting up radosgw (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:48.084 INFO:teuthology.orchestra.run.trial148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:12:48.084 INFO:teuthology.orchestra.run.trial148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-17T11:12:48.469 INFO:teuthology.orchestra.run.trial148.stdout:Setting up ceph-base (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:48.586 INFO:teuthology.orchestra.run.trial148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-17T11:12:48.976 INFO:teuthology.orchestra.run.trial148.stdout:Setting up ceph-mds (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:49.035 INFO:teuthology.orchestra.run.trial148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T11:12:49.035 INFO:teuthology.orchestra.run.trial148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-17T11:12:49.406 INFO:teuthology.orchestra.run.trial148.stdout:Setting up ceph-mgr (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:49.483 INFO:teuthology.orchestra.run.trial148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T11:12:49.483 INFO:teuthology.orchestra.run.trial148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-17T11:12:49.879 INFO:teuthology.orchestra.run.trial148.stdout:Setting up ceph-osd (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:49.966 INFO:teuthology.orchestra.run.trial148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T11:12:49.966 INFO:teuthology.orchestra.run.trial148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-17T11:12:50.370 INFO:teuthology.orchestra.run.trial148.stdout:Setting up ceph-mgr-k8sevents (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:50.371 INFO:teuthology.orchestra.run.trial148.stdout:Setting up ceph-mgr-diskprediction-local (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:50.381 INFO:teuthology.orchestra.run.trial148.stdout:Setting up ceph-mon (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:50.456 INFO:teuthology.orchestra.run.trial148.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T11:12:50.456 INFO:teuthology.orchestra.run.trial148.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-17T11:12:50.851 INFO:teuthology.orchestra.run.trial148.stdout:Setting up ceph-mgr-cephadm (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:50.863 INFO:teuthology.orchestra.run.trial148.stdout:Setting up ceph (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:50.864 INFO:teuthology.orchestra.run.trial148.stdout:Setting up ceph-mgr-dashboard (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:50.874 INFO:teuthology.orchestra.run.trial148.stdout:Setting up ceph-volume (19.2.3-705-g04cf6dd4-1jammy) ... 2026-02-17T11:12:50.986 INFO:teuthology.orchestra.run.trial148.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2026-02-17T11:12:50.995 INFO:teuthology.orchestra.run.trial148.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-17T11:12:51.013 INFO:teuthology.orchestra.run.trial148.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-17T11:12:51.105 INFO:teuthology.orchestra.run.trial148.stdout:Processing triggers for install-info (6.8-4build1) ... 2026-02-17T11:12:51.595 INFO:teuthology.orchestra.run.trial148.stdout: 2026-02-17T11:12:51.596 INFO:teuthology.orchestra.run.trial148.stdout:Running kernel seems to be up-to-date. 2026-02-17T11:12:51.596 INFO:teuthology.orchestra.run.trial148.stdout: 2026-02-17T11:12:51.596 INFO:teuthology.orchestra.run.trial148.stdout:The processor microcode seems to be up-to-date. 2026-02-17T11:12:51.596 INFO:teuthology.orchestra.run.trial148.stdout: 2026-02-17T11:12:51.596 INFO:teuthology.orchestra.run.trial148.stdout:No services need to be restarted. 2026-02-17T11:12:51.596 INFO:teuthology.orchestra.run.trial148.stdout: 2026-02-17T11:12:51.596 INFO:teuthology.orchestra.run.trial148.stdout:No containers need to be restarted. 2026-02-17T11:12:51.596 INFO:teuthology.orchestra.run.trial148.stdout: 2026-02-17T11:12:51.596 INFO:teuthology.orchestra.run.trial148.stdout:No user sessions are running outdated binaries. 2026-02-17T11:12:51.596 INFO:teuthology.orchestra.run.trial148.stdout: 2026-02-17T11:12:51.597 INFO:teuthology.orchestra.run.trial148.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-17T11:12:52.233 INFO:teuthology.orchestra.run.trial148.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-17T11:12:52.239 DEBUG:teuthology.parallel:result is None 2026-02-17T11:12:52.240 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T11:12:52.406 DEBUG:teuthology.orchestra.run.trial148:> dpkg-query -W -f '${Version}' ceph 2026-02-17T11:12:52.416 INFO:teuthology.orchestra.run.trial148.stdout:19.2.3-705-g04cf6dd4-1jammy 2026-02-17T11:12:52.416 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-705-g04cf6dd4-1jammy 2026-02-17T11:12:52.417 INFO:teuthology.task.install:The correct ceph version 19.2.3-705-g04cf6dd4-1jammy is installed. 2026-02-17T11:12:52.418 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T11:12:52.419 DEBUG:teuthology.orchestra.run.trial148:> set -ex 2026-02-17T11:12:52.419 DEBUG:teuthology.orchestra.run.trial148:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T11:12:52.469 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T11:12:52.469 DEBUG:teuthology.orchestra.run.trial148:> set -ex 2026-02-17T11:12:52.469 DEBUG:teuthology.orchestra.run.trial148:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T11:12:52.520 DEBUG:teuthology.orchestra.run.trial148:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T11:12:52.571 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T11:12:52.571 DEBUG:teuthology.orchestra.run.trial148:> set -ex 2026-02-17T11:12:52.571 DEBUG:teuthology.orchestra.run.trial148:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T11:12:52.621 DEBUG:teuthology.orchestra.run.trial148:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T11:12:52.671 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T11:12:52.672 DEBUG:teuthology.orchestra.run.trial148:> set -ex 2026-02-17T11:12:52.672 DEBUG:teuthology.orchestra.run.trial148:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T11:12:52.720 DEBUG:teuthology.orchestra.run.trial148:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T11:12:52.771 INFO:teuthology.run_tasks:Running task workunit... 2026-02-17T11:12:52.797 INFO:tasks.workunit:Pulling workunits from ref 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T11:12:52.797 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-17T11:12:52.798 INFO:tasks.workunit:timeout=3h 2026-02-17T11:12:52.798 INFO:tasks.workunit:cleanup=True 2026-02-17T11:12:52.798 DEBUG:teuthology.orchestra.run.trial148:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-17T11:12:52.815 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:12:52.815 INFO:teuthology.orchestra.run.trial148.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-17T11:12:52.816 DEBUG:teuthology.orchestra.run.trial148:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T11:12:52.863 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-17T11:12:52.864 DEBUG:teuthology.orchestra.run.trial148:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-17T11:12:52.907 DEBUG:teuthology.orchestra.run.trial148:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 04cf6dd4be446d06026adad18a5fbf5da1fa8c0e 2026-02-17T11:12:52.958 INFO:tasks.workunit.client.0.trial148.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-17T11:13:15.260 INFO:tasks.workunit.client.0.trial148.stderr:Note: switching to '04cf6dd4be446d06026adad18a5fbf5da1fa8c0e'. 2026-02-17T11:13:15.260 INFO:tasks.workunit.client.0.trial148.stderr: 2026-02-17T11:13:15.260 INFO:tasks.workunit.client.0.trial148.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-17T11:13:15.260 INFO:tasks.workunit.client.0.trial148.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-17T11:13:15.260 INFO:tasks.workunit.client.0.trial148.stderr:state without impacting any branches by switching back to a branch. 2026-02-17T11:13:15.261 INFO:tasks.workunit.client.0.trial148.stderr: 2026-02-17T11:13:15.261 INFO:tasks.workunit.client.0.trial148.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-17T11:13:15.261 INFO:tasks.workunit.client.0.trial148.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-17T11:13:15.261 INFO:tasks.workunit.client.0.trial148.stderr: 2026-02-17T11:13:15.261 INFO:tasks.workunit.client.0.trial148.stderr: git switch -c 2026-02-17T11:13:15.261 INFO:tasks.workunit.client.0.trial148.stderr: 2026-02-17T11:13:15.261 INFO:tasks.workunit.client.0.trial148.stderr:Or undo this operation with: 2026-02-17T11:13:15.261 INFO:tasks.workunit.client.0.trial148.stderr: 2026-02-17T11:13:15.261 INFO:tasks.workunit.client.0.trial148.stderr: git switch - 2026-02-17T11:13:15.261 INFO:tasks.workunit.client.0.trial148.stderr: 2026-02-17T11:13:15.261 INFO:tasks.workunit.client.0.trial148.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-17T11:13:15.262 INFO:tasks.workunit.client.0.trial148.stderr: 2026-02-17T11:13:15.262 INFO:tasks.workunit.client.0.trial148.stderr:HEAD is now at 04cf6dd4be4 Merge branch 'wip-squid-update-spdk' of https://github.com/tchaikov/ceph into wip-bharath19-testing-2026-02-13-0903-squid 2026-02-17T11:13:15.270 DEBUG:teuthology.orchestra.run.trial148:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-17T11:13:15.317 DEBUG:teuthology.orchestra.run.trial148:> set -ex 2026-02-17T11:13:15.317 DEBUG:teuthology.orchestra.run.trial148:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-17T11:13:15.366 INFO:tasks.workunit:Running workunits matching osd on client.0... 2026-02-17T11:13:15.368 INFO:tasks.workunit:Running workunit osd/bad-inc-map.sh... 2026-02-17T11:13:15.368 DEBUG:teuthology.orchestra.run.trial148:workunit test osd/bad-inc-map.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh 2026-02-17T11:13:15.418 INFO:tasks.workunit.client.0.trial148.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T11:13:15.435 INFO:tasks.workunit.client.0.trial148.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T11:13:15.435 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T11:13:15.435 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T11:13:15.435 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: export PYTHONWARNINGS=ignore 2026-02-17T11:13:15.435 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: PYTHONWARNINGS=ignore 2026-02-17T11:13:15.435 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: export CEPH_CONF=/dev/null 2026-02-17T11:13:15.435 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: CEPH_CONF=/dev/null 2026-02-17T11:13:15.435 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: main: unset CEPH_ARGS 2026-02-17T11:13:15.435 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: main: local code 2026-02-17T11:13:15.435 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: main: run td/bad-inc-map 2026-02-17T11:13:15.435 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:8: run: local dir=td/bad-inc-map 2026-02-17T11:13:15.435 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:9: run: shift 2026-02-17T11:13:15.435 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: export CEPH_MON=127.0.0.1:45051 2026-02-17T11:13:15.435 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: CEPH_MON=127.0.0.1:45051 2026-02-17T11:13:15.435 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:12: run: export CEPH_ARGS 2026-02-17T11:13:15.435 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: uuidgen 2026-02-17T11:13:15.436 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: CEPH_ARGS+='--fsid=927c0e6e-807b-443b-878f-f2232732a02e --auth-supported=none ' 2026-02-17T11:13:15.436 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:14: run: CEPH_ARGS+='--mon-host=127.0.0.1:45051 ' 2026-02-17T11:13:15.436 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:15: run: set -e 2026-02-17T11:13:15.436 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: set 2026-02-17T11:13:15.436 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T11:13:15.438 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: local funcs=TEST_bad_inc_map 2026-02-17T11:13:15.438 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:18: run: for func in $funcs 2026-02-17T11:13:15.438 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:19: run: setup td/bad-inc-map 2026-02-17T11:13:15.438 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/bad-inc-map 2026-02-17T11:13:15.438 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/bad-inc-map 2026-02-17T11:13:15.438 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/bad-inc-map 2026-02-17T11:13:15.439 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T11:13:15.439 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/bad-inc-map KILL 2026-02-17T11:13:15.439 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:13:15.439 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:13:15.439 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:13:15.439 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:13:15.439 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:13:15.441 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:13:15.441 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:13:15.442 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:13:15.442 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:13:15.443 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:13:15.443 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:13:15.443 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:13:15.444 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:13:15.444 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:13:15.444 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:13:15.445 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:13:15.446 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:13:15.447 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T11:13:15.447 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/bad-inc-map 2026-02-17T11:13:15.448 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:13:15.448 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:13:15.448 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11817 2026-02-17T11:13:15.448 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11817 2026-02-17T11:13:15.449 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T11:13:15.449 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T11:13:15.449 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/bad-inc-map 2026-02-17T11:13:15.451 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T11:13:15.451 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:13:15.451 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11817 2026-02-17T11:13:15.451 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.11817 2026-02-17T11:13:15.453 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T11:13:15.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2026-02-17T11:13:15.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2026-02-17T11:13:15.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T11:13:15.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/bad-inc-map 1' TERM HUP INT 2026-02-17T11:13:15.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:20: run: TEST_bad_inc_map td/bad-inc-map 2026-02-17T11:13:15.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:26: TEST_bad_inc_map: local dir=td/bad-inc-map 2026-02-17T11:13:15.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:28: TEST_bad_inc_map: run_mon td/bad-inc-map a 2026-02-17T11:13:15.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/bad-inc-map 2026-02-17T11:13:15.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T11:13:15.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T11:13:15.454 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T11:13:15.454 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/bad-inc-map/a 2026-02-17T11:13:15.454 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/bad-inc-map/a --run-dir=td/bad-inc-map 2026-02-17T11:13:15.484 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T11:13:15.484 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:13:15.484 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:13:15.484 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:13:15.484 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:13:15.484 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11817 2026-02-17T11:13:15.484 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11817/$cluster-$name.asok' 2026-02-17T11:13:15.485 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/bad-inc-map/a '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.11817/$cluster-$name.asok' --mon-cluster-log-file=td/bad-inc-map/log --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T11:13:15.512 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T11:13:15.513 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T11:13:15.513 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T11:13:15.513 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T11:13:15.513 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T11:13:15.513 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T11:13:15.514 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T11:13:15.514 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T11:13:15.514 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T11:13:15.514 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:13:15.514 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:13:15.514 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11817 2026-02-17T11:13:15.514 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11817/ceph-mon.a.asok 2026-02-17T11:13:15.515 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T11:13:15.515 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11817/ceph-mon.a.asok config get fsid 2026-02-17T11:13:15.573 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T11:13:15.573 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T11:13:15.573 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T11:13:15.573 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T11:13:15.573 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T11:13:15.574 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T11:13:15.574 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T11:13:15.574 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T11:13:15.574 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:13:15.574 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:13:15.574 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11817 2026-02-17T11:13:15.574 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.11817/ceph-mon.a.asok 2026-02-17T11:13:15.574 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T11:13:15.575 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.11817/ceph-mon.a.asok config get mon_host 2026-02-17T11:13:15.627 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:29: TEST_bad_inc_map: run_mgr td/bad-inc-map x 2026-02-17T11:13:15.628 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/bad-inc-map 2026-02-17T11:13:15.628 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T11:13:15.628 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T11:13:15.628 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T11:13:15.628 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/bad-inc-map/x 2026-02-17T11:13:15.628 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T11:13:15.734 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T11:13:15.734 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:13:15.734 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:13:15.735 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:13:15.735 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:13:15.735 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11817 2026-02-17T11:13:15.735 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11817/$cluster-$name.asok' 2026-02-17T11:13:15.735 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T11:13:15.736 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/bad-inc-map/x '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.11817/$cluster-$name.asok' --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T11:13:15.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:30: TEST_bad_inc_map: run_osd td/bad-inc-map 0 2026-02-17T11:13:15.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/bad-inc-map 2026-02-17T11:13:15.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:13:15.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T11:13:15.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:13:15.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/bad-inc-map/0 2026-02-17T11:13:15.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=927c0e6e-807b-443b-878f-f2232732a02e --auth-supported=none --mon-host=127.0.0.1:45051 ' 2026-02-17T11:13:15.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:13:15.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:13:15.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:13:15.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/0' 2026-02-17T11:13:15.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/0/journal' 2026-02-17T11:13:15.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:13:15.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:13:15.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-17T11:13:15.758 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:13:15.758 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:13:15.758 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:13:15.758 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:13:15.758 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:13:15.758 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11817 2026-02-17T11:13:15.758 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11817/$cluster-$name.asok' 2026-02-17T11:13:15.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11817/$cluster-$name.asok' 2026-02-17T11:13:15.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:13:15.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:13:15.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:13:15.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-17T11:13:15.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-17T11:13:15.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:13:15.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:13:15.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:13:15.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:13:15.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:13:15.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:13:15.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/bad-inc-map/0 2026-02-17T11:13:15.759 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:13:15.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=1dff96ec-e675-41c0-a6f6-9ac76bbce585 2026-02-17T11:13:15.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 1dff96ec-e675-41c0-a6f6-9ac76bbce585' 2026-02-17T11:13:15.760 INFO:tasks.workunit.client.0.trial148.stdout:add osd0 1dff96ec-e675-41c0-a6f6-9ac76bbce585 2026-02-17T11:13:15.760 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:13:15.770 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBLTZRpy5bALRAAUHjSLV2RKkrvSXwMg8wo+g== 2026-02-17T11:13:15.770 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBLTZRpy5bALRAAUHjSLV2RKkrvSXwMg8wo+g=="}' 2026-02-17T11:13:15.770 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 1dff96ec-e675-41c0-a6f6-9ac76bbce585 -i td/bad-inc-map/0/new.json 2026-02-17T11:13:15.879 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:13:15.887 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/bad-inc-map/0/new.json 2026-02-17T11:13:15.888 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=927c0e6e-807b-443b-878f-f2232732a02e --auth-supported=none --mon-host=127.0.0.1:45051 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.11817/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBLTZRpy5bALRAAUHjSLV2RKkrvSXwMg8wo+g== --osd-uuid 1dff96ec-e675-41c0-a6f6-9ac76bbce585 2026-02-17T11:13:15.903 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:15.896+0000 7f5da40ff8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:15.905 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:15.900+0000 7f5da40ff8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:15.906 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:15.900+0000 7f5da40ff8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:15.906 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:15.900+0000 7f5da40ff8c0 -1 bdev(0x562aba837c00 td/bad-inc-map/0/block) open stat got: (1) Operation not permitted 2026-02-17T11:13:15.906 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:15.900+0000 7f5da40ff8c0 -1 bluestore(td/bad-inc-map/0) _read_fsid unparsable uuid 2026-02-17T11:13:18.778 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/bad-inc-map/0/keyring 2026-02-17T11:13:18.778 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:13:18.779 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T11:13:18.779 INFO:tasks.workunit.client.0.trial148.stdout:adding osd0 key to auth repository 2026-02-17T11:13:18.779 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/bad-inc-map/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:13:19.052 INFO:tasks.workunit.client.0.trial148.stdout:start osd.0 2026-02-17T11:13:19.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T11:13:19.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=927c0e6e-807b-443b-878f-f2232732a02e --auth-supported=none --mon-host=127.0.0.1:45051 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.11817/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:13:19.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:13:19.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:13:19.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:13:19.074 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:19.068+0000 7f53bca2e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:19.076 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:19.068+0000 7f53bca2e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:19.077 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:19.072+0000 7f53bca2e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:19.248 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T11:13:19.248 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:13:19.248 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T11:13:19.248 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:13:19.248 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:13:19.248 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:13:19.248 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:13:19.248 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:13:19.248 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:13:19.248 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:13:19.448 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:13:20.449 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:13:20.450 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:13:20.450 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:13:20.451 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:13:20.451 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:13:20.451 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:13:20.586 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:20.580+0000 7f53bca2e8c0 -1 Falling back to public interface 2026-02-17T11:13:20.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:13:21.661 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:13:21.661 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:13:21.661 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:13:21.661 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:13:21.662 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:13:21.662 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:13:21.856 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:13:22.857 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:13:22.857 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:13:22.857 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:13:22.857 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:13:22.857 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:13:22.857 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:13:23.060 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:13:23.564 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:23.555+0000 7f53bca2e8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T11:13:24.062 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:13:24.062 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:13:24.062 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:13:24.062 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:13:24.063 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:13:24.063 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:13:24.264 INFO:tasks.workunit.client.0.trial148.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/121145522,v1:127.0.0.1:6803/121145522] [v2:127.0.0.1:6804/121145522,v1:127.0.0.1:6805/121145522] exists,up 1dff96ec-e675-41c0-a6f6-9ac76bbce585 2026-02-17T11:13:24.267 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:13:24.267 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:13:24.267 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:13:24.267 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:31: TEST_bad_inc_map: run_osd td/bad-inc-map 1 2026-02-17T11:13:24.267 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/bad-inc-map 2026-02-17T11:13:24.267 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:13:24.268 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T11:13:24.268 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:13:24.268 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/bad-inc-map/1 2026-02-17T11:13:24.268 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=927c0e6e-807b-443b-878f-f2232732a02e --auth-supported=none --mon-host=127.0.0.1:45051 ' 2026-02-17T11:13:24.268 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:13:24.268 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:13:24.268 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:13:24.268 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/1' 2026-02-17T11:13:24.268 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/1/journal' 2026-02-17T11:13:24.268 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:13:24.268 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:13:24.268 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-17T11:13:24.269 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:13:24.269 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:13:24.269 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:13:24.269 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:13:24.269 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:13:24.269 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11817 2026-02-17T11:13:24.269 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11817/$cluster-$name.asok' 2026-02-17T11:13:24.269 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11817/$cluster-$name.asok' 2026-02-17T11:13:24.269 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:13:24.269 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:13:24.269 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:13:24.269 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-17T11:13:24.270 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-17T11:13:24.270 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:13:24.270 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:13:24.270 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:13:24.270 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:13:24.270 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:13:24.270 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:13:24.270 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/bad-inc-map/1 2026-02-17T11:13:24.270 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:13:24.271 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=e7a81aa5-c326-4282-b6ec-2e149f9210fb 2026-02-17T11:13:24.271 INFO:tasks.workunit.client.0.trial148.stdout:add osd1 e7a81aa5-c326-4282-b6ec-2e149f9210fb 2026-02-17T11:13:24.271 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 e7a81aa5-c326-4282-b6ec-2e149f9210fb' 2026-02-17T11:13:24.272 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:13:24.279 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBUTZRpe+xsEBAAPLhv96liYjMQm87Fa/FFCg== 2026-02-17T11:13:24.279 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBUTZRpe+xsEBAAPLhv96liYjMQm87Fa/FFCg=="}' 2026-02-17T11:13:24.279 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new e7a81aa5-c326-4282-b6ec-2e149f9210fb -i td/bad-inc-map/1/new.json 2026-02-17T11:13:24.476 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:13:24.484 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/bad-inc-map/1/new.json 2026-02-17T11:13:24.485 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=927c0e6e-807b-443b-878f-f2232732a02e --auth-supported=none --mon-host=127.0.0.1:45051 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.11817/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBUTZRpe+xsEBAAPLhv96liYjMQm87Fa/FFCg== --osd-uuid e7a81aa5-c326-4282-b6ec-2e149f9210fb 2026-02-17T11:13:24.501 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:24.495+0000 7f23d57478c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:24.502 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:24.495+0000 7f23d57478c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:24.503 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:24.495+0000 7f23d57478c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:24.504 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:24.495+0000 7f23d57478c0 -1 bdev(0x55fcd5af3c00 td/bad-inc-map/1/block) open stat got: (1) Operation not permitted 2026-02-17T11:13:24.504 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:24.495+0000 7f23d57478c0 -1 bluestore(td/bad-inc-map/1) _read_fsid unparsable uuid 2026-02-17T11:13:27.009 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/bad-inc-map/1/keyring 2026-02-17T11:13:27.010 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:13:27.010 INFO:tasks.workunit.client.0.trial148.stdout:adding osd1 key to auth repository 2026-02-17T11:13:27.011 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T11:13:27.011 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/bad-inc-map/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:13:27.284 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T11:13:27.285 INFO:tasks.workunit.client.0.trial148.stdout:start osd.1 2026-02-17T11:13:27.286 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=927c0e6e-807b-443b-878f-f2232732a02e --auth-supported=none --mon-host=127.0.0.1:45051 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.11817/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:13:27.286 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:13:27.286 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:13:27.286 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:13:27.307 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:27.299+0000 7f195a6508c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:27.309 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:27.299+0000 7f195a6508c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:27.310 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:27.303+0000 7f195a6508c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:27.479 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T11:13:27.479 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:13:27.479 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T11:13:27.479 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:13:27.479 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:13:27.479 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:13:27.480 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:13:27.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:13:27.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:13:27.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:13:27.682 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:13:28.683 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:13:28.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:13:28.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:13:28.684 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:13:28.685 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:13:28.685 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:13:28.810 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:28.803+0000 7f195a6508c0 -1 Falling back to public interface 2026-02-17T11:13:28.880 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:13:29.882 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:13:29.882 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:13:29.882 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:13:29.883 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:13:29.883 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:13:29.883 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:13:30.078 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:13:31.080 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:13:31.080 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:13:31.080 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:13:31.080 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:13:31.081 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:13:31.081 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:13:31.277 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:13:31.864 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:31.855+0000 7f195a6508c0 -1 osd.1 0 log_to_monitors true 2026-02-17T11:13:32.278 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:13:32.278 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:13:32.279 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:13:32.279 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:13:32.279 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:13:32.280 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:13:32.479 INFO:tasks.workunit.client.0.trial148.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3802591283,v1:127.0.0.1:6811/3802591283] [v2:127.0.0.1:6812/3802591283,v1:127.0.0.1:6813/3802591283] exists,up e7a81aa5-c326-4282-b6ec-2e149f9210fb 2026-02-17T11:13:32.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:13:32.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:13:32.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:13:32.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:32: TEST_bad_inc_map: run_osd td/bad-inc-map 2 2026-02-17T11:13:32.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/bad-inc-map 2026-02-17T11:13:32.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:13:32.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T11:13:32.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:13:32.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/bad-inc-map/2 2026-02-17T11:13:32.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=927c0e6e-807b-443b-878f-f2232732a02e --auth-supported=none --mon-host=127.0.0.1:45051 ' 2026-02-17T11:13:32.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:13:32.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:13:32.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:13:32.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/2' 2026-02-17T11:13:32.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/2/journal' 2026-02-17T11:13:32.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:13:32.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:13:32.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-17T11:13:32.481 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:13:32.481 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:13:32.481 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:13:32.482 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:13:32.482 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:13:32.482 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11817 2026-02-17T11:13:32.483 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.11817/$cluster-$name.asok' 2026-02-17T11:13:32.483 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.11817/$cluster-$name.asok' 2026-02-17T11:13:32.483 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:13:32.483 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:13:32.484 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:13:32.484 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-17T11:13:32.484 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-17T11:13:32.484 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:13:32.484 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:13:32.484 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:13:32.484 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:13:32.484 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:13:32.484 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:13:32.484 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/bad-inc-map/2 2026-02-17T11:13:32.484 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:13:32.485 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=6fb5f9f0-0a82-44e0-9b1d-93cf9b204047 2026-02-17T11:13:32.485 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 6fb5f9f0-0a82-44e0-9b1d-93cf9b204047' 2026-02-17T11:13:32.485 INFO:tasks.workunit.client.0.trial148.stdout:add osd2 6fb5f9f0-0a82-44e0-9b1d-93cf9b204047 2026-02-17T11:13:32.486 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:13:32.496 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBcTZRp8wVTHRAA17HT0xMWa3TSyhKD405fgg== 2026-02-17T11:13:32.496 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBcTZRp8wVTHRAA17HT0xMWa3TSyhKD405fgg=="}' 2026-02-17T11:13:32.496 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 6fb5f9f0-0a82-44e0-9b1d-93cf9b204047 -i td/bad-inc-map/2/new.json 2026-02-17T11:13:32.709 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:13:32.718 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/bad-inc-map/2/new.json 2026-02-17T11:13:32.719 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=927c0e6e-807b-443b-878f-f2232732a02e --auth-supported=none --mon-host=127.0.0.1:45051 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.11817/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBcTZRp8wVTHRAA17HT0xMWa3TSyhKD405fgg== --osd-uuid 6fb5f9f0-0a82-44e0-9b1d-93cf9b204047 2026-02-17T11:13:32.734 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:32.727+0000 7f4b58c028c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:32.735 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:32.727+0000 7f4b58c028c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:32.736 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:32.727+0000 7f4b58c028c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:32.737 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:32.731+0000 7f4b58c028c0 -1 bdev(0x55886e317c00 td/bad-inc-map/2/block) open stat got: (1) Operation not permitted 2026-02-17T11:13:32.737 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:32.731+0000 7f4b58c028c0 -1 bluestore(td/bad-inc-map/2) _read_fsid unparsable uuid 2026-02-17T11:13:35.017 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/bad-inc-map/2/keyring 2026-02-17T11:13:35.017 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:13:35.019 INFO:tasks.workunit.client.0.trial148.stdout:adding osd2 key to auth repository 2026-02-17T11:13:35.019 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T11:13:35.019 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/bad-inc-map/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:13:35.295 INFO:tasks.workunit.client.0.trial148.stdout:start osd.2 2026-02-17T11:13:35.296 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T11:13:35.296 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=927c0e6e-807b-443b-878f-f2232732a02e --auth-supported=none --mon-host=127.0.0.1:45051 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.11817/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:13:35.297 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:13:35.297 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:13:35.297 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:13:35.317 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:35.311+0000 7f197041b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:35.319 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:35.311+0000 7f197041b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:35.320 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:35.311+0000 7f197041b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:35.490 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T11:13:35.490 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:13:35.490 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T11:13:35.490 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:13:35.490 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:13:35.490 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:13:35.491 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:13:35.491 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:13:35.491 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:13:35.492 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:13:35.696 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:13:36.697 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:13:36.697 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:13:36.697 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:13:36.697 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:13:36.697 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:13:36.697 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:13:36.823 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:36.815+0000 7f197041b8c0 -1 Falling back to public interface 2026-02-17T11:13:36.898 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:13:37.900 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:13:37.900 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:13:37.900 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:13:37.901 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:13:37.901 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:13:37.901 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:13:38.100 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:13:39.101 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:13:39.102 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:13:39.102 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:13:39.103 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:13:39.103 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:13:39.103 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:13:39.302 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:13:40.047 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:40.039+0000 7f197041b8c0 -1 osd.2 0 log_to_monitors true 2026-02-17T11:13:40.303 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:13:40.303 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:13:40.303 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:13:40.304 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:13:40.304 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:13:40.304 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:13:40.504 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:13:41.506 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:13:41.506 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:13:41.506 INFO:tasks.workunit.client.0.trial148.stdout:5 2026-02-17T11:13:41.507 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T11:13:41.507 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:13:41.507 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:13:41.705 INFO:tasks.workunit.client.0.trial148.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/500496539,v1:127.0.0.1:6819/500496539] [v2:127.0.0.1:6820/500496539,v1:127.0.0.1:6821/500496539] exists,up 6fb5f9f0-0a82-44e0-9b1d-93cf9b204047 2026-02-17T11:13:41.705 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:13:41.705 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:13:41.705 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:13:41.705 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:34: TEST_bad_inc_map: ceph config set osd.2 osd_inject_bad_map_crc_probability 1 2026-02-17T11:13:41.907 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:37: TEST_bad_inc_map: create_pool foo 8 2026-02-17T11:13:41.907 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create foo 8 2026-02-17T11:13:42.166 INFO:tasks.workunit.client.0.trial148.stderr:pool 'foo' already exists 2026-02-17T11:13:42.175 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T11:13:43.177 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:38: TEST_bad_inc_map: ceph osd pool set foo min_size 1 2026-02-17T11:13:43.474 INFO:tasks.workunit.client.0.trial148.stderr:set pool 1 min_size to 1 2026-02-17T11:13:43.484 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:39: TEST_bad_inc_map: ceph osd pool set foo min_size 2 2026-02-17T11:13:43.779 INFO:tasks.workunit.client.0.trial148.stderr:set pool 1 min_size to 2 2026-02-17T11:13:43.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:41: TEST_bad_inc_map: sleep 5 2026-02-17T11:13:48.793 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: TIMEOUT=10 2026-02-17T11:13:48.793 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: wait_for_osd up 0 2026-02-17T11:13:48.793 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:13:48.793 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T11:13:48.793 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:13:48.793 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:13:48.794 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 10 )) 2026-02-17T11:13:48.794 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:13:48.794 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:13:48.794 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:13:48.795 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:13:48.992 INFO:tasks.workunit.client.0.trial148.stdout:osd.0 up in weight 1 up_from 5 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/121145522,v1:127.0.0.1:6803/121145522] [v2:127.0.0.1:6804/121145522,v1:127.0.0.1:6805/121145522] exists,up 1dff96ec-e675-41c0-a6f6-9ac76bbce585 2026-02-17T11:13:48.993 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:13:48.994 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:13:48.994 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:13:48.994 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: TIMEOUT=10 2026-02-17T11:13:48.994 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: wait_for_osd up 1 2026-02-17T11:13:48.994 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:13:48.994 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T11:13:48.994 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:13:48.994 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:13:48.994 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 10 )) 2026-02-17T11:13:48.995 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:13:48.995 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:13:48.996 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:13:48.996 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:13:49.194 INFO:tasks.workunit.client.0.trial148.stdout:osd.1 up in weight 1 up_from 9 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3802591283,v1:127.0.0.1:6811/3802591283] [v2:127.0.0.1:6812/3802591283,v1:127.0.0.1:6813/3802591283] exists,up e7a81aa5-c326-4282-b6ec-2e149f9210fb 2026-02-17T11:13:49.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:13:49.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:13:49.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:13:49.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: TIMEOUT=10 2026-02-17T11:13:49.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: wait_for_osd up 2 2026-02-17T11:13:49.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:13:49.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T11:13:49.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:13:49.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:13:49.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 10 )) 2026-02-17T11:13:49.196 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:13:49.196 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:13:49.196 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:13:49.197 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:13:49.393 INFO:tasks.workunit.client.0.trial148.stdout:osd.2 up in weight 1 up_from 13 up_thru 20 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/500496539,v1:127.0.0.1:6819/500496539] [v2:127.0.0.1:6820/500496539,v1:127.0.0.1:6821/500496539] exists,up 6fb5f9f0-0a82-44e0-9b1d-93cf9b204047 2026-02-17T11:13:49.394 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:13:49.394 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:13:49.394 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:13:49.394 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:49: TEST_bad_inc_map: grep 'injecting map crc failure' td/bad-inc-map/osd.2.log 2026-02-17T11:13:49.395 INFO:tasks.workunit.client.0.trial148.stdout:2026-02-17T11:13:42.215+0000 7f195fa74640 -1 osd.2 13 handle_osd_map injecting map crc failure 2026-02-17T11:13:49.395 INFO:tasks.workunit.client.0.trial148.stdout:2026-02-17T11:13:42.319+0000 7f195fa74640 -1 osd.2 15 handle_osd_map injecting map crc failure 2026-02-17T11:13:49.395 INFO:tasks.workunit.client.0.trial148.stdout:2026-02-17T11:13:42.751+0000 7f195fa74640 -1 osd.2 16 handle_osd_map injecting map crc failure 2026-02-17T11:13:49.395 INFO:tasks.workunit.client.0.trial148.stdout:2026-02-17T11:13:43.363+0000 7f195da70640 -1 osd.2 17 handle_osd_map injecting map crc failure 2026-02-17T11:13:49.395 INFO:tasks.workunit.client.0.trial148.stdout:2026-02-17T11:13:43.467+0000 7f195fa74640 -1 osd.2 18 handle_osd_map injecting map crc failure 2026-02-17T11:13:49.395 INFO:tasks.workunit.client.0.trial148.stdout:2026-02-17T11:13:43.467+0000 7f195fa74640 -1 osd.2 18 handle_osd_map injecting map crc failure 2026-02-17T11:13:49.396 INFO:tasks.workunit.client.0.trial148.stdout:2026-02-17T11:13:43.671+0000 7f195da70640 -1 osd.2 19 handle_osd_map injecting map crc failure 2026-02-17T11:13:49.396 INFO:tasks.workunit.client.0.trial148.stdout:2026-02-17T11:13:43.771+0000 7f195fa74640 -1 osd.2 20 handle_osd_map injecting map crc failure 2026-02-17T11:13:49.396 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:50: TEST_bad_inc_map: grep 'bailing because last' td/bad-inc-map/osd.2.log 2026-02-17T11:13:49.397 INFO:tasks.workunit.client.0.trial148.stdout:2026-02-17T11:13:42.215+0000 7f195fa74640 10 osd.2 13 handle_osd_map bailing because last < start (13<14) 2026-02-17T11:13:49.397 INFO:tasks.workunit.client.0.trial148.stdout:2026-02-17T11:13:42.319+0000 7f195fa74640 10 osd.2 15 handle_osd_map bailing because last < start (15<16) 2026-02-17T11:13:49.397 INFO:tasks.workunit.client.0.trial148.stdout:2026-02-17T11:13:42.751+0000 7f195fa74640 10 osd.2 16 handle_osd_map bailing because last < start (16<17) 2026-02-17T11:13:49.397 INFO:tasks.workunit.client.0.trial148.stdout:2026-02-17T11:13:43.363+0000 7f195da70640 10 osd.2 17 handle_osd_map bailing because last < start (17<18) 2026-02-17T11:13:49.397 INFO:tasks.workunit.client.0.trial148.stdout:2026-02-17T11:13:43.467+0000 7f195fa74640 10 osd.2 18 handle_osd_map bailing because last < start (18<19) 2026-02-17T11:13:49.397 INFO:tasks.workunit.client.0.trial148.stdout:2026-02-17T11:13:43.467+0000 7f195fa74640 10 osd.2 18 handle_osd_map bailing because last < start (18<19) 2026-02-17T11:13:49.397 INFO:tasks.workunit.client.0.trial148.stdout:2026-02-17T11:13:43.671+0000 7f195da70640 10 osd.2 19 handle_osd_map bailing because last < start (19<20) 2026-02-17T11:13:49.397 INFO:tasks.workunit.client.0.trial148.stdout:2026-02-17T11:13:43.771+0000 7f195fa74640 10 osd.2 20 handle_osd_map bailing because last < start (20<21) 2026-02-17T11:13:49.397 INFO:tasks.workunit.client.0.trial148.stdout:success 2026-02-17T11:13:49.398 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:52: TEST_bad_inc_map: echo success 2026-02-17T11:13:49.398 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:54: TEST_bad_inc_map: delete_pool foo 2026-02-17T11:13:49.398 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=foo 2026-02-17T11:13:49.398 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete foo foo --yes-i-really-really-mean-it 2026-02-17T11:13:49.644 INFO:tasks.workunit.client.0.trial148.stderr:pool 'foo' does not exist 2026-02-17T11:13:49.652 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:55: TEST_bad_inc_map: kill_daemons td/bad-inc-map 2026-02-17T11:13:49.653 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:13:49.653 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:13:49.653 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:13:49.653 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:13:49.653 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:13:57.970 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:13:57.970 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:21: run: teardown td/bad-inc-map 2026-02-17T11:13:57.970 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/bad-inc-map 2026-02-17T11:13:57.970 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T11:13:57.970 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/bad-inc-map KILL 2026-02-17T11:13:57.971 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:13:57.971 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:13:57.971 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:13:57.972 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:13:57.972 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:13:57.977 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:13:57.977 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:13:57.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:13:57.978 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:13:57.979 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:13:57.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:13:57.980 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:13:57.981 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:13:57.981 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:13:57.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:13:57.982 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:13:57.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:13:57.983 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T11:13:57.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/bad-inc-map 2026-02-17T11:13:57.993 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:13:57.993 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:13:57.993 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11817 2026-02-17T11:13:57.993 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11817 2026-02-17T11:13:57.995 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T11:13:57.995 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T11:13:57.995 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: main: code=0 2026-02-17T11:13:57.996 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: main: teardown td/bad-inc-map 0 2026-02-17T11:13:57.996 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/bad-inc-map 2026-02-17T11:13:57.996 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2026-02-17T11:13:57.996 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/bad-inc-map KILL 2026-02-17T11:13:57.996 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:13:57.996 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:13:57.996 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:13:57.996 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:13:57.996 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:13:57.997 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:13:57.998 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:13:57.998 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:13:57.999 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:13:57.999 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:13:58.000 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:13:58.000 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:13:58.001 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:13:58.001 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:13:58.002 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:13:58.002 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:13:58.002 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:13:58.003 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T11:13:58.003 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/bad-inc-map 2026-02-17T11:13:58.005 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:13:58.005 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:13:58.005 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.11817 2026-02-17T11:13:58.005 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.11817 2026-02-17T11:13:58.006 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T11:13:58.006 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T11:13:58.006 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: main: return 0 2026-02-17T11:13:58.008 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T11:13:58.008 DEBUG:teuthology.orchestra.run.trial148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T11:13:58.062 INFO:tasks.workunit:Running workunit osd/divergent-priors.sh... 2026-02-17T11:13:58.062 DEBUG:teuthology.orchestra.run.trial148:workunit test osd/divergent-priors.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh 2026-02-17T11:13:58.115 INFO:tasks.workunit.client.0.trial148.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T11:13:58.120 INFO:tasks.workunit.client.0.trial148.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T11:13:58.120 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T11:13:58.120 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T11:13:58.120 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: export PYTHONWARNINGS=ignore 2026-02-17T11:13:58.120 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: PYTHONWARNINGS=ignore 2026-02-17T11:13:58.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: export CEPH_CONF=/dev/null 2026-02-17T11:13:58.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: CEPH_CONF=/dev/null 2026-02-17T11:13:58.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: main: unset CEPH_ARGS 2026-02-17T11:13:58.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: main: local code 2026-02-17T11:13:58.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: main: run td/divergent-priors 2026-02-17T11:13:58.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:21: run: local dir=td/divergent-priors 2026-02-17T11:13:58.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:22: run: shift 2026-02-17T11:13:58.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: export loglen=12 2026-02-17T11:13:58.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: loglen=12 2026-02-17T11:13:58.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: export divisor=3 2026-02-17T11:13:58.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: divisor=3 2026-02-17T11:13:58.121 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: expr 12 / 2 2026-02-17T11:13:58.123 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: export trim=6 2026-02-17T11:13:58.123 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: trim=6 2026-02-17T11:13:58.123 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: expr 6 / 3 2026-02-17T11:13:58.123 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: export DIVERGENT_WRITE=2 2026-02-17T11:13:58.123 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: DIVERGENT_WRITE=2 2026-02-17T11:13:58.123 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: expr 6 / 3 2026-02-17T11:13:58.124 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: export DIVERGENT_REMOVE=2 2026-02-17T11:13:58.124 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: DIVERGENT_REMOVE=2 2026-02-17T11:13:58.124 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: expr 6 / 3 2026-02-17T11:13:58.126 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: export DIVERGENT_CREATE=2 2026-02-17T11:13:58.126 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: DIVERGENT_CREATE=2 2026-02-17T11:13:58.126 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: export poolname=test 2026-02-17T11:13:58.126 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: poolname=test 2026-02-17T11:13:58.126 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: export testobjects=100 2026-02-17T11:13:58.126 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: testobjects=100 2026-02-17T11:13:58.127 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: export CEPH_MON=127.0.0.1:7115 2026-02-17T11:13:58.127 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: CEPH_MON=127.0.0.1:7115 2026-02-17T11:13:58.127 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:35: run: export CEPH_ARGS 2026-02-17T11:13:58.127 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: uuidgen 2026-02-17T11:13:58.128 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: CEPH_ARGS+='--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none ' 2026-02-17T11:13:58.128 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:37: run: CEPH_ARGS+='--mon-host=127.0.0.1:7115 ' 2026-02-17T11:13:58.128 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:39: run: CEPH_ARGS+='--osd_force_auth_primary_missing_objects=1000000 ' 2026-02-17T11:13:58.128 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:40: run: CEPH_ARGS+='--osd_debug_pg_log_writeout=true ' 2026-02-17T11:13:58.128 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:41: run: CEPH_ARGS+='--osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:13:58.128 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: set 2026-02-17T11:13:58.128 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T11:13:58.131 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: local 'funcs=TEST_divergent 2026-02-17T11:13:58.131 INFO:tasks.workunit.client.0.trial148.stderr:TEST_divergent_2 2026-02-17T11:13:58.131 INFO:tasks.workunit.client.0.trial148.stderr:TEST_divergent_3 2026-02-17T11:13:58.131 INFO:tasks.workunit.client.0.trial148.stderr:TEST_divergent_ec' 2026-02-17T11:13:58.131 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-17T11:13:58.131 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-17T11:13:58.132 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/divergent-priors 2026-02-17T11:13:58.132 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/divergent-priors 2026-02-17T11:13:58.132 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/divergent-priors 2026-02-17T11:13:58.132 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T11:13:58.132 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T11:13:58.132 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:13:58.132 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:13:58.132 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:13:58.132 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:13:58.132 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:13:58.133 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:13:58.133 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:13:58.134 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:13:58.134 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:13:58.136 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:13:58.136 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:13:58.136 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:13:58.137 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:13:58.137 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:13:58.138 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:13:58.138 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:13:58.138 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:13:58.140 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T11:13:58.140 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/divergent-priors 2026-02-17T11:13:58.141 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:13:58.142 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:13:58.142 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:13:58.142 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.19803 2026-02-17T11:13:58.143 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T11:13:58.143 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T11:13:58.143 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/divergent-priors 2026-02-17T11:13:58.145 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T11:13:58.145 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:13:58.145 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:13:58.145 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.19803 2026-02-17T11:13:58.146 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T11:13:58.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2026-02-17T11:13:58.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2026-02-17T11:13:58.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T11:13:58.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-17T11:13:58.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent td/divergent-priors 2026-02-17T11:13:58.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:57: TEST_divergent: local dir=td/divergent-priors 2026-02-17T11:13:58.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:60: TEST_divergent: local dummyfile=/etc/fstab 2026-02-17T11:13:58.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: local dummyfile2=/etc/resolv.conf 2026-02-17T11:13:58.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:63: TEST_divergent: local num_osds=3 2026-02-17T11:13:58.148 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: expr 3 - 1 2026-02-17T11:13:58.149 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: seq 0 2 2026-02-17T11:13:58.150 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: local 'osds=0 2026-02-17T11:13:58.150 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:13:58.150 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:13:58.151 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:65: TEST_divergent: run_mon td/divergent-priors a 2026-02-17T11:13:58.151 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/divergent-priors 2026-02-17T11:13:58.151 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T11:13:58.151 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T11:13:58.151 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T11:13:58.151 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/divergent-priors/a 2026-02-17T11:13:58.151 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-17T11:13:58.173 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T11:13:58.173 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:13:58.173 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:13:58.173 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:13:58.174 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:13:58.174 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:13:58.174 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:13:58.174 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T11:13:58.203 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T11:13:58.204 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T11:13:58.204 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T11:13:58.204 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T11:13:58.204 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T11:13:58.205 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T11:13:58.206 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T11:13:58.206 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T11:13:58.206 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T11:13:58.206 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:13:58.206 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:13:58.206 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:13:58.206 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-mon.a.asok 2026-02-17T11:13:58.206 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T11:13:58.206 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.19803/ceph-mon.a.asok config get fsid 2026-02-17T11:13:58.262 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T11:13:58.262 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T11:13:58.262 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T11:13:58.262 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T11:13:58.262 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T11:13:58.262 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T11:13:58.262 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T11:13:58.263 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T11:13:58.263 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:13:58.263 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:13:58.263 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:13:58.263 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-mon.a.asok 2026-02-17T11:13:58.264 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T11:13:58.264 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.19803/ceph-mon.a.asok config get mon_host 2026-02-17T11:13:58.316 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_mgr td/divergent-priors x 2026-02-17T11:13:58.316 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/divergent-priors 2026-02-17T11:13:58.316 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T11:13:58.316 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T11:13:58.316 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T11:13:58.316 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/divergent-priors/x 2026-02-17T11:13:58.316 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T11:13:58.428 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T11:13:58.428 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:13:58.429 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:13:58.429 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:13:58.429 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:13:58.429 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:13:58.429 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:13:58.430 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T11:13:58.430 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T11:13:58.452 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:67: TEST_divergent: for i in $osds 2026-02-17T11:13:58.452 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:69: TEST_divergent: run_osd td/divergent-priors 0 2026-02-17T11:13:58.452 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/divergent-priors 2026-02-17T11:13:58.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:13:58.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T11:13:58.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:13:58.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/divergent-priors/0 2026-02-17T11:13:58.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:13:58.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:13:58.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:13:58.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:13:58.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T11:13:58.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T11:13:58.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:13:58.454 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:13:58.454 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:13:58.454 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:13:58.454 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:13:58.454 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:13:58.454 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:13:58.454 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:13:58.454 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:13:58.454 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:13:58.454 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:13:58.454 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:13:58.454 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:13:58.454 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:13:58.455 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:13:58.455 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:13:58.455 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:13:58.455 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:13:58.455 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:13:58.455 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:13:58.455 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:13:58.455 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:13:58.455 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/divergent-priors/0 2026-02-17T11:13:58.455 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:13:58.456 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=951a1d3e-5227-4925-8600-0a5d6411bee8 2026-02-17T11:13:58.456 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 951a1d3e-5227-4925-8600-0a5d6411bee8' 2026-02-17T11:13:58.456 INFO:tasks.workunit.client.0.trial148.stdout:add osd0 951a1d3e-5227-4925-8600-0a5d6411bee8 2026-02-17T11:13:58.457 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:13:58.467 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQB2TZRpeyWQGxAAKgKpAk0xekBxTPIukCAyjA== 2026-02-17T11:13:58.467 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQB2TZRpeyWQGxAAKgKpAk0xekBxTPIukCAyjA=="}' 2026-02-17T11:13:58.467 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 951a1d3e-5227-4925-8600-0a5d6411bee8 -i td/divergent-priors/0/new.json 2026-02-17T11:13:58.580 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:13:58.588 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/divergent-priors/0/new.json 2026-02-17T11:13:58.589 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB2TZRpeyWQGxAAKgKpAk0xekBxTPIukCAyjA== --osd-uuid 951a1d3e-5227-4925-8600-0a5d6411bee8 2026-02-17T11:13:58.607 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:58.598+0000 7f5cd776e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:58.608 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:58.598+0000 7f5cd776e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:58.609 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:58.598+0000 7f5cd776e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:13:58.610 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:58.598+0000 7f5cd776e8c0 -1 bdev(0x561564c7bc00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-17T11:13:58.610 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:13:58.598+0000 7f5cd776e8c0 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-17T11:14:01.198 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-17T11:14:01.199 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:14:01.199 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T11:14:01.200 INFO:tasks.workunit.client.0.trial148.stdout:adding osd0 key to auth repository 2026-02-17T11:14:01.200 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:14:01.478 INFO:tasks.workunit.client.0.trial148.stdout:start osd.0 2026-02-17T11:14:01.479 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T11:14:01.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:14:01.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:14:01.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:14:01.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:14:01.505 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:01.494+0000 7f393471f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:01.507 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:01.498+0000 7f393471f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:01.508 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:01.498+0000 7f393471f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:01.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T11:14:01.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:14:01.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T11:14:01.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:14:01.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:14:01.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:01.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:14:01.684 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:14:01.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:01.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:14:01.886 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:14:02.888 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:14:02.888 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:02.888 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:14:02.889 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:14:02.889 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:02.890 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:14:03.035 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:03.026+0000 7f393471f8c0 -1 Falling back to public interface 2026-02-17T11:14:03.092 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:14:04.093 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:14:04.094 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:04.094 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:14:04.095 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:14:04.095 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:04.095 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:14:04.293 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:14:05.295 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:14:05.295 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:05.295 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:14:05.295 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:14:05.296 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:05.296 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:14:05.502 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:14:06.061 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:06.050+0000 7f393471f8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T11:14:06.503 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:14:06.503 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:06.503 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:14:06.504 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:14:06.504 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:06.504 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:14:06.702 INFO:tasks.workunit.client.0.trial148.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1074131565,v1:127.0.0.1:6803/1074131565] [v2:127.0.0.1:6804/1074131565,v1:127.0.0.1:6805/1074131565] exists,up 951a1d3e-5227-4925-8600-0a5d6411bee8 2026-02-17T11:14:06.708 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:14:06.709 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:14:06.709 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:14:06.709 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:67: TEST_divergent: for i in $osds 2026-02-17T11:14:06.709 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:69: TEST_divergent: run_osd td/divergent-priors 1 2026-02-17T11:14:06.709 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/divergent-priors 2026-02-17T11:14:06.709 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:14:06.710 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T11:14:06.710 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:14:06.710 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/divergent-priors/1 2026-02-17T11:14:06.710 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:14:06.710 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:14:06.710 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:14:06.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:14:06.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T11:14:06.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T11:14:06.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:14:06.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:14:06.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:14:06.712 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:14:06.712 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:14:06.712 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:14:06.712 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:14:06.712 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:14:06.712 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:14:06.712 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:14:06.713 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:14:06.713 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:14:06.713 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:14:06.713 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:14:06.713 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:14:06.713 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:14:06.714 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:14:06.714 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:14:06.714 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:14:06.714 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:14:06.714 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:14:06.714 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:14:06.715 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/divergent-priors/1 2026-02-17T11:14:06.715 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:14:06.715 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=793cab14-e8f0-48e0-b312-0d146e33192d 2026-02-17T11:14:06.715 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 793cab14-e8f0-48e0-b312-0d146e33192d' 2026-02-17T11:14:06.716 INFO:tasks.workunit.client.0.trial148.stdout:add osd1 793cab14-e8f0-48e0-b312-0d146e33192d 2026-02-17T11:14:06.716 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:14:06.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQB+TZRpJ/qoKhAACntab8PwcsgxybES1FsDRg== 2026-02-17T11:14:06.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQB+TZRpJ/qoKhAACntab8PwcsgxybES1FsDRg=="}' 2026-02-17T11:14:06.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 793cab14-e8f0-48e0-b312-0d146e33192d -i td/divergent-priors/1/new.json 2026-02-17T11:14:06.929 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:14:06.938 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/divergent-priors/1/new.json 2026-02-17T11:14:06.939 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB+TZRpJ/qoKhAACntab8PwcsgxybES1FsDRg== --osd-uuid 793cab14-e8f0-48e0-b312-0d146e33192d 2026-02-17T11:14:06.958 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:06.946+0000 7f86e3fb08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:06.959 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:06.950+0000 7f86e3fb08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:06.960 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:06.950+0000 7f86e3fb08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:06.960 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:06.950+0000 7f86e3fb08c0 -1 bdev(0x55b8c209dc00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-17T11:14:06.961 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:06.950+0000 7f86e3fb08c0 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-17T11:14:09.254 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-17T11:14:09.254 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:14:09.255 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T11:14:09.255 INFO:tasks.workunit.client.0.trial148.stdout:adding osd1 key to auth repository 2026-02-17T11:14:09.256 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:14:09.535 INFO:tasks.workunit.client.0.trial148.stdout:start osd.1 2026-02-17T11:14:09.535 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T11:14:09.535 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:14:09.535 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:14:09.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:14:09.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:14:09.563 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:09.558+0000 7fd2a4f428c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:09.564 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:09.558+0000 7fd2a4f428c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:09.566 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:09.558+0000 7fd2a4f428c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:09.741 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T11:14:09.741 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:14:09.741 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T11:14:09.742 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:14:09.742 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:14:09.742 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:09.742 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:14:09.742 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:14:09.743 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:09.743 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:14:09.943 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:14:10.944 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:14:10.945 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:10.945 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:14:10.946 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:14:10.946 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:10.946 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:14:11.048 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:11.042+0000 7fd2a4f428c0 -1 Falling back to public interface 2026-02-17T11:14:11.144 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:14:12.145 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:14:12.145 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:12.146 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:14:12.146 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:14:12.146 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:12.146 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:14:12.347 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:14:13.349 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:14:13.349 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:13.350 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:14:13.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:14:13.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:13.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:14:13.556 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:14:14.279 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:14.274+0000 7fd2a4f428c0 -1 osd.1 0 log_to_monitors true 2026-02-17T11:14:14.557 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:14:14.557 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:14.557 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:14:14.557 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:14:14.558 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:14.558 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:14:14.752 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:14:15.754 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:14:15.754 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:15.754 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T11:14:15.755 INFO:tasks.workunit.client.0.trial148.stdout:5 2026-02-17T11:14:15.755 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:15.755 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:14:15.964 INFO:tasks.workunit.client.0.trial148.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2172046260,v1:127.0.0.1:6811/2172046260] [v2:127.0.0.1:6812/2172046260,v1:127.0.0.1:6813/2172046260] exists,up 793cab14-e8f0-48e0-b312-0d146e33192d 2026-02-17T11:14:15.968 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:14:15.968 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:14:15.968 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:14:15.968 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:67: TEST_divergent: for i in $osds 2026-02-17T11:14:15.968 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:69: TEST_divergent: run_osd td/divergent-priors 2 2026-02-17T11:14:15.968 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/divergent-priors 2026-02-17T11:14:15.968 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:14:15.968 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T11:14:15.968 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:14:15.968 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/divergent-priors/2 2026-02-17T11:14:15.969 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:14:15.969 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:14:15.969 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:14:15.969 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:14:15.969 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T11:14:15.969 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T11:14:15.969 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:14:15.969 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:14:15.969 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:14:15.969 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:14:15.969 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:14:15.970 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:14:15.970 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:14:15.970 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:14:15.970 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:14:15.970 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:14:15.970 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:14:15.970 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:14:15.970 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:14:15.970 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:14:15.970 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:14:15.970 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:14:15.970 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:14:15.970 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:14:15.971 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:14:15.971 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:14:15.971 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:14:15.971 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:14:15.971 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/divergent-priors/2 2026-02-17T11:14:15.971 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:14:15.971 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=fc05ccb6-8c79-4405-8211-08924f11237c 2026-02-17T11:14:15.972 INFO:tasks.workunit.client.0.trial148.stdout:add osd2 fc05ccb6-8c79-4405-8211-08924f11237c 2026-02-17T11:14:15.972 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 fc05ccb6-8c79-4405-8211-08924f11237c' 2026-02-17T11:14:15.972 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:14:15.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCHTZRp4vlHOhAARgGo64/NesyJLqzqruX8tQ== 2026-02-17T11:14:15.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCHTZRp4vlHOhAARgGo64/NesyJLqzqruX8tQ=="}' 2026-02-17T11:14:15.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new fc05ccb6-8c79-4405-8211-08924f11237c -i td/divergent-priors/2/new.json 2026-02-17T11:14:16.183 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:14:16.192 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/divergent-priors/2/new.json 2026-02-17T11:14:16.193 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCHTZRp4vlHOhAARgGo64/NesyJLqzqruX8tQ== --osd-uuid fc05ccb6-8c79-4405-8211-08924f11237c 2026-02-17T11:14:16.210 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:16.206+0000 7f55b98be8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:16.212 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:16.206+0000 7f55b98be8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:16.213 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:16.206+0000 7f55b98be8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:16.214 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:16.206+0000 7f55b98be8c0 -1 bdev(0x5592baccbc00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-17T11:14:16.214 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:16.206+0000 7f55b98be8c0 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-17T11:14:18.499 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-17T11:14:18.499 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:14:18.500 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T11:14:18.500 INFO:tasks.workunit.client.0.trial148.stdout:adding osd2 key to auth repository 2026-02-17T11:14:18.500 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:14:18.784 INFO:tasks.workunit.client.0.trial148.stdout:start osd.2 2026-02-17T11:14:18.785 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T11:14:18.785 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:14:18.785 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:14:18.785 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:14:18.785 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:14:18.811 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:18.806+0000 7f3e8cc138c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:18.813 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:18.806+0000 7f3e8cc138c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:18.814 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:18.806+0000 7f3e8cc138c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:18.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T11:14:18.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:14:18.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T11:14:18.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:14:18.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:14:18.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:18.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:14:18.989 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:14:18.990 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:18.990 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:14:19.183 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:14:20.184 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:14:20.184 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:20.185 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:14:20.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:14:20.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:20.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:14:20.312 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:20.306+0000 7f3e8cc138c0 -1 Falling back to public interface 2026-02-17T11:14:20.385 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:14:21.387 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:14:21.387 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:21.387 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:14:21.388 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:14:21.388 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:21.388 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:14:21.586 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:14:22.587 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:14:22.587 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:22.588 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:14:22.588 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:14:22.589 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:22.589 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:14:22.785 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:14:23.531 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:23.526+0000 7f3e8cc138c0 -1 osd.2 0 log_to_monitors true 2026-02-17T11:14:23.785 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:14:23.785 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:23.786 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:14:23.786 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:14:23.786 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:23.786 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:14:23.985 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:14:24.986 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:14:24.986 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:24.987 INFO:tasks.workunit.client.0.trial148.stdout:5 2026-02-17T11:14:24.987 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T11:14:24.988 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:24.988 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:14:25.181 INFO:tasks.workunit.client.0.trial148.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3684602780,v1:127.0.0.1:6819/3684602780] [v2:127.0.0.1:6820/3684602780,v1:127.0.0.1:6821/3684602780] exists,up fc05ccb6-8c79-4405-8211-08924f11237c 2026-02-17T11:14:25.182 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:14:25.182 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:14:25.182 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:14:25.182 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:72: TEST_divergent: ceph osd set noout 2026-02-17T11:14:25.479 INFO:tasks.workunit.client.0.trial148.stderr:noout is set 2026-02-17T11:14:25.491 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:73: TEST_divergent: ceph osd set noin 2026-02-17T11:14:25.784 INFO:tasks.workunit.client.0.trial148.stderr:noin is set 2026-02-17T11:14:25.797 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:74: TEST_divergent: ceph osd set nodown 2026-02-17T11:14:26.092 INFO:tasks.workunit.client.0.trial148.stderr:nodown is set 2026-02-17T11:14:26.103 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:75: TEST_divergent: create_pool test 1 1 2026-02-17T11:14:26.103 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 2026-02-17T11:14:26.343 INFO:tasks.workunit.client.0.trial148.stderr:pool 'test' already exists 2026-02-17T11:14:26.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T11:14:27.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:76: TEST_divergent: ceph osd pool set test size 3 2026-02-17T11:14:27.649 INFO:tasks.workunit.client.0.trial148.stderr:set pool 1 size to 3 2026-02-17T11:14:27.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:77: TEST_divergent: ceph osd pool set test min_size 2 2026-02-17T11:14:27.954 INFO:tasks.workunit.client.0.trial148.stderr:set pool 1 min_size to 2 2026-02-17T11:14:27.964 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:79: TEST_divergent: flush_pg_stats 2026-02-17T11:14:27.965 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:14:27.965 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:14:28.164 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:14:28.164 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:14:28.164 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:14:28.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:14:28.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:14:28.165 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:14:28.246 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836487 2026-02-17T11:14:28.246 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836487 2026-02-17T11:14:28.246 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T11:14:28.246 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:14:28.246 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:14:28.325 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705669 2026-02-17T11:14:28.325 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705669 2026-02-17T11:14:28.325 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487 1-38654705669' 2026-02-17T11:14:28.325 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:14:28.326 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:14:28.407 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574851 2026-02-17T11:14:28.407 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574851 2026-02-17T11:14:28.407 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487 1-38654705669 2-55834574851' 2026-02-17T11:14:28.407 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:14:28.408 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836487 2026-02-17T11:14:28.408 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:14:28.409 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:14:28.409 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836487 2026-02-17T11:14:28.410 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:14:28.411 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836487 2026-02-17T11:14:28.411 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T11:14:28.411 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 21474836487 2026-02-17T11:14:28.412 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:14:28.625 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836484 -lt 21474836487 2026-02-17T11:14:28.625 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:14:29.627 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:14:29.628 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:14:29.829 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T11:14:29.829 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:14:29.830 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705669 2026-02-17T11:14:29.830 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:14:29.831 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T11:14:29.831 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705669 2026-02-17T11:14:29.832 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:14:29.833 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705669 2026-02-17T11:14:29.833 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.1 seq 38654705669 2026-02-17T11:14:29.834 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-17T11:14:29.834 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T11:14:30.048 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705669 -lt 38654705669 2026-02-17T11:14:30.048 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:14:30.049 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-55834574851 2026-02-17T11:14:30.049 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:14:30.050 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:14:30.051 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-55834574851 2026-02-17T11:14:30.051 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:14:30.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574851 2026-02-17T11:14:30.052 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 55834574851 2026-02-17T11:14:30.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 55834574851' 2026-02-17T11:14:30.053 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:14:30.259 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574851 -lt 55834574851 2026-02-17T11:14:30.260 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: wait_for_clean 2026-02-17T11:14:30.260 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T11:14:30.260 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T11:14:30.260 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T11:14:30.260 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T11:14:30.260 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T11:14:30.260 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T11:14:30.261 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T11:14:30.261 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T11:14:30.262 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T11:14:30.359 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T11:14:30.359 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T11:14:30.360 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T11:14:30.360 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T11:14:30.360 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:14:30.360 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:14:30.572 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:14:30.572 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:14:30.572 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:14:30.573 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:14:30.573 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:14:30.573 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:14:30.652 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836489 2026-02-17T11:14:30.653 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836489 2026-02-17T11:14:30.653 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836489' 2026-02-17T11:14:30.653 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:14:30.653 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:14:30.733 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705672 2026-02-17T11:14:30.733 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705672 2026-02-17T11:14:30.733 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836489 1-38654705672' 2026-02-17T11:14:30.733 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:14:30.733 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:14:30.812 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574854 2026-02-17T11:14:30.812 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574854 2026-02-17T11:14:30.812 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836489 1-38654705672 2-55834574854' 2026-02-17T11:14:30.812 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:14:30.813 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836489 2026-02-17T11:14:30.813 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:14:30.814 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:14:30.815 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836489 2026-02-17T11:14:30.815 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:14:30.816 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836489 2026-02-17T11:14:30.816 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836489' 2026-02-17T11:14:30.817 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 21474836489 2026-02-17T11:14:30.817 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:14:31.026 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836489 -lt 21474836489 2026-02-17T11:14:31.026 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:14:31.027 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705672 2026-02-17T11:14:31.027 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:14:31.028 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T11:14:31.029 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705672 2026-02-17T11:14:31.029 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:14:31.030 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705672 2026-02-17T11:14:31.030 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.1 seq 38654705672 2026-02-17T11:14:31.031 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705672' 2026-02-17T11:14:31.031 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T11:14:31.241 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705670 -lt 38654705672 2026-02-17T11:14:31.242 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:14:32.243 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:14:32.243 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T11:14:32.446 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705670 -lt 38654705672 2026-02-17T11:14:32.446 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:14:33.447 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T11:14:33.448 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T11:14:33.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705672 -lt 38654705672 2026-02-17T11:14:33.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:14:33.660 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-55834574854 2026-02-17T11:14:33.660 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:14:33.661 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:14:33.662 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-55834574854 2026-02-17T11:14:33.662 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:14:33.663 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574854 2026-02-17T11:14:33.663 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 55834574854' 2026-02-17T11:14:33.664 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 55834574854 2026-02-17T11:14:33.664 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:14:33.864 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574854 -lt 55834574854 2026-02-17T11:14:33.864 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T11:14:33.865 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:14:33.865 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:14:34.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 == 0 2026-02-17T11:14:34.122 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:14:34.122 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:14:34.122 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:14:34.122 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:14:34.122 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:14:34.122 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:14:34.122 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:14:34.316 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=1 2026-02-17T11:14:34.317 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:14:34.317 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:14:34.317 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:14:34.573 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 1 = 1 2026-02-17T11:14:34.573 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T11:14:34.573 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T11:14:34.573 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:83: TEST_divergent: ceph pg dump pgs --format=json 2026-02-17T11:14:34.574 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:83: TEST_divergent: jq '.pg_stats[0].up_primary' 2026-02-17T11:14:34.761 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:14:34.771 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:83: TEST_divergent: local divergent=1 2026-02-17T11:14:34.771 INFO:tasks.workunit.client.0.trial148.stdout:primary and soon to be divergent is 1 2026-02-17T11:14:34.771 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: echo 'primary and soon to be divergent is 1' 2026-02-17T11:14:34.771 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:85: TEST_divergent: ceph pg dump pgs 2026-02-17T11:14:34.968 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:14:34.968 INFO:tasks.workunit.client.0.trial148.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T11:14:26.551463+0000 0'0 26:23 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:14:26.288530+0000 0'0 2026-02-17T11:14:26.288530+0000 0 0 periodic scrub scheduled @ 2026-02-18T20:07:06.757334+0000 0 0 2026-02-17T11:14:34.968 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:14:34.968 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:14:34.969 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:14:34.977 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: local non_divergent= 2026-02-17T11:14:34.977 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:87: TEST_divergent: for i in $osds 2026-02-17T11:14:34.977 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: '[' 0 = 1 ']' 2026-02-17T11:14:34.977 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:92: TEST_divergent: non_divergent=' 0' 2026-02-17T11:14:34.977 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:87: TEST_divergent: for i in $osds 2026-02-17T11:14:34.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: '[' 1 = 1 ']' 2026-02-17T11:14:34.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:90: TEST_divergent: continue 2026-02-17T11:14:34.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:87: TEST_divergent: for i in $osds 2026-02-17T11:14:34.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: '[' 2 = 1 ']' 2026-02-17T11:14:34.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:92: TEST_divergent: non_divergent=' 0 2' 2026-02-17T11:14:34.978 INFO:tasks.workunit.client.0.trial148.stdout:writing initial objects 2026-02-17T11:14:34.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:95: TEST_divergent: echo 'writing initial objects' 2026-02-17T11:14:34.978 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: seq 1 100 2026-02-17T11:14:34.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:34.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_1 /etc/fstab 2026-02-17T11:14:35.000 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.000 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_2 /etc/fstab 2026-02-17T11:14:35.027 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.027 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_3 /etc/fstab 2026-02-17T11:14:35.046 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.046 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_4 /etc/fstab 2026-02-17T11:14:35.074 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.074 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_5 /etc/fstab 2026-02-17T11:14:35.101 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.101 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_6 /etc/fstab 2026-02-17T11:14:35.129 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.129 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_7 /etc/fstab 2026-02-17T11:14:35.157 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.157 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_8 /etc/fstab 2026-02-17T11:14:35.184 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.184 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_9 /etc/fstab 2026-02-17T11:14:35.212 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.212 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_10 /etc/fstab 2026-02-17T11:14:35.240 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.240 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_11 /etc/fstab 2026-02-17T11:14:35.268 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.268 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_12 /etc/fstab 2026-02-17T11:14:35.296 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.296 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_13 /etc/fstab 2026-02-17T11:14:35.324 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.324 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_14 /etc/fstab 2026-02-17T11:14:35.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_15 /etc/fstab 2026-02-17T11:14:35.379 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.379 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_16 /etc/fstab 2026-02-17T11:14:35.403 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.403 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_17 /etc/fstab 2026-02-17T11:14:35.431 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.432 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_18 /etc/fstab 2026-02-17T11:14:35.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_19 /etc/fstab 2026-02-17T11:14:35.485 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.485 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_20 /etc/fstab 2026-02-17T11:14:35.513 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.514 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_21 /etc/fstab 2026-02-17T11:14:35.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.542 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_22 /etc/fstab 2026-02-17T11:14:35.568 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.569 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_23 /etc/fstab 2026-02-17T11:14:35.596 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.596 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_24 /etc/fstab 2026-02-17T11:14:35.624 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.624 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_25 /etc/fstab 2026-02-17T11:14:35.652 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.652 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_26 /etc/fstab 2026-02-17T11:14:35.680 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.680 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_27 /etc/fstab 2026-02-17T11:14:35.708 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.708 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_28 /etc/fstab 2026-02-17T11:14:35.737 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.737 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_29 /etc/fstab 2026-02-17T11:14:35.764 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.765 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_30 /etc/fstab 2026-02-17T11:14:35.792 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.792 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_31 /etc/fstab 2026-02-17T11:14:35.820 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.820 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_32 /etc/fstab 2026-02-17T11:14:35.847 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.847 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_33 /etc/fstab 2026-02-17T11:14:35.873 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.873 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_34 /etc/fstab 2026-02-17T11:14:35.900 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.900 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_35 /etc/fstab 2026-02-17T11:14:35.927 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.927 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_36 /etc/fstab 2026-02-17T11:14:35.953 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.953 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_37 /etc/fstab 2026-02-17T11:14:35.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:35.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_38 /etc/fstab 2026-02-17T11:14:36.005 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.005 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_39 /etc/fstab 2026-02-17T11:14:36.028 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.028 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_40 /etc/fstab 2026-02-17T11:14:36.055 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.055 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_41 /etc/fstab 2026-02-17T11:14:36.083 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.083 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_42 /etc/fstab 2026-02-17T11:14:36.111 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.111 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_43 /etc/fstab 2026-02-17T11:14:36.134 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.134 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_44 /etc/fstab 2026-02-17T11:14:36.160 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.160 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_45 /etc/fstab 2026-02-17T11:14:36.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_46 /etc/fstab 2026-02-17T11:14:36.215 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.216 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_47 /etc/fstab 2026-02-17T11:14:36.243 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.244 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_48 /etc/fstab 2026-02-17T11:14:36.264 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.264 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_49 /etc/fstab 2026-02-17T11:14:36.291 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.291 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_50 /etc/fstab 2026-02-17T11:14:36.318 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.318 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_51 /etc/fstab 2026-02-17T11:14:36.348 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.348 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_52 /etc/fstab 2026-02-17T11:14:36.374 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.374 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_53 /etc/fstab 2026-02-17T11:14:36.403 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.403 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_54 /etc/fstab 2026-02-17T11:14:36.430 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.430 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_55 /etc/fstab 2026-02-17T11:14:36.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_56 /etc/fstab 2026-02-17T11:14:36.487 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.487 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_57 /etc/fstab 2026-02-17T11:14:36.507 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.507 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_58 /etc/fstab 2026-02-17T11:14:36.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_59 /etc/fstab 2026-02-17T11:14:36.562 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.562 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_60 /etc/fstab 2026-02-17T11:14:36.591 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.591 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_61 /etc/fstab 2026-02-17T11:14:36.620 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.621 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_62 /etc/fstab 2026-02-17T11:14:36.648 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.649 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_63 /etc/fstab 2026-02-17T11:14:36.676 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.676 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_64 /etc/fstab 2026-02-17T11:14:36.704 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.704 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_65 /etc/fstab 2026-02-17T11:14:36.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_66 /etc/fstab 2026-02-17T11:14:36.760 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.760 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_67 /etc/fstab 2026-02-17T11:14:36.788 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.788 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_68 /etc/fstab 2026-02-17T11:14:36.816 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.816 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_69 /etc/fstab 2026-02-17T11:14:36.844 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.844 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_70 /etc/fstab 2026-02-17T11:14:36.872 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.873 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_71 /etc/fstab 2026-02-17T11:14:36.899 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.900 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_72 /etc/fstab 2026-02-17T11:14:36.928 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.928 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_73 /etc/fstab 2026-02-17T11:14:36.955 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.955 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_74 /etc/fstab 2026-02-17T11:14:36.981 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:36.981 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_75 /etc/fstab 2026-02-17T11:14:37.008 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.008 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_76 /etc/fstab 2026-02-17T11:14:37.036 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.036 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_77 /etc/fstab 2026-02-17T11:14:37.063 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.064 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_78 /etc/fstab 2026-02-17T11:14:37.091 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.092 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_79 /etc/fstab 2026-02-17T11:14:37.119 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.119 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_80 /etc/fstab 2026-02-17T11:14:37.147 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.147 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_81 /etc/fstab 2026-02-17T11:14:37.175 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.175 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_82 /etc/fstab 2026-02-17T11:14:37.196 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.196 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_83 /etc/fstab 2026-02-17T11:14:37.223 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.223 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_84 /etc/fstab 2026-02-17T11:14:37.249 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.249 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_85 /etc/fstab 2026-02-17T11:14:37.277 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.277 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_86 /etc/fstab 2026-02-17T11:14:37.304 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.304 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_87 /etc/fstab 2026-02-17T11:14:37.332 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.332 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_88 /etc/fstab 2026-02-17T11:14:37.360 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.360 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_89 /etc/fstab 2026-02-17T11:14:37.387 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.388 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_90 /etc/fstab 2026-02-17T11:14:37.416 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.416 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_91 /etc/fstab 2026-02-17T11:14:37.444 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.445 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_92 /etc/fstab 2026-02-17T11:14:37.472 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.472 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_93 /etc/fstab 2026-02-17T11:14:37.500 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.500 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_94 /etc/fstab 2026-02-17T11:14:37.527 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.527 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_95 /etc/fstab 2026-02-17T11:14:37.548 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.548 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_96 /etc/fstab 2026-02-17T11:14:37.574 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.574 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_97 /etc/fstab 2026-02-17T11:14:37.600 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.600 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_98 /etc/fstab 2026-02-17T11:14:37.628 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.628 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_99 /etc/fstab 2026-02-17T11:14:37.656 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:97: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-17T11:14:37.656 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: rados -p test put existing_100 /etc/fstab 2026-02-17T11:14:37.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:102: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T11:14:37.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:102: TEST_divergent: wait_for_clean 2026-02-17T11:14:37.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T11:14:37.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T11:14:37.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T11:14:37.684 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T11:14:37.685 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T11:14:37.685 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T11:14:37.685 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T11:14:37.685 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T11:14:37.685 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T11:14:37.755 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T11:14:37.756 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T11:14:37.756 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T11:14:37.756 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T11:14:37.756 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:14:37.756 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:14:37.954 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:14:37.954 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:14:37.955 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:14:37.955 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:14:37.955 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:14:37.955 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:14:38.033 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836493 2026-02-17T11:14:38.033 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836493 2026-02-17T11:14:38.033 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836493' 2026-02-17T11:14:38.033 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:14:38.034 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:14:38.112 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705675 2026-02-17T11:14:38.112 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705675 2026-02-17T11:14:38.112 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836493 1-38654705675' 2026-02-17T11:14:38.112 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:14:38.113 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:14:38.193 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=55834574857 2026-02-17T11:14:38.193 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 55834574857 2026-02-17T11:14:38.193 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836493 1-38654705675 2-55834574857' 2026-02-17T11:14:38.193 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:14:38.194 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836493 2026-02-17T11:14:38.194 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:14:38.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:14:38.196 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836493 2026-02-17T11:14:38.196 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:14:38.197 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836493 2026-02-17T11:14:38.198 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836493' 2026-02-17T11:14:38.198 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 21474836493 2026-02-17T11:14:38.198 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:14:38.413 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836490 -lt 21474836493 2026-02-17T11:14:38.413 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:14:39.415 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:14:39.415 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:14:39.616 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836493 -lt 21474836493 2026-02-17T11:14:39.616 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:14:39.617 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705675 2026-02-17T11:14:39.617 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:14:39.618 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T11:14:39.619 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705675 2026-02-17T11:14:39.620 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:14:39.621 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705675 2026-02-17T11:14:39.621 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.1 seq 38654705675 2026-02-17T11:14:39.622 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705675' 2026-02-17T11:14:39.622 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T11:14:39.836 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705675 -lt 38654705675 2026-02-17T11:14:39.836 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:14:39.837 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-55834574857 2026-02-17T11:14:39.837 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:14:39.838 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:14:39.839 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-55834574857 2026-02-17T11:14:39.839 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:14:39.840 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=55834574857 2026-02-17T11:14:39.841 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 55834574857' 2026-02-17T11:14:39.841 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 55834574857 2026-02-17T11:14:39.841 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:14:40.047 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 55834574857 -lt 55834574857 2026-02-17T11:14:40.048 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T11:14:40.048 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:14:40.048 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:14:40.309 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 == 0 2026-02-17T11:14:40.309 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:14:40.309 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:14:40.309 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:14:40.309 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:14:40.309 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:14:40.309 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:14:40.310 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:14:40.500 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=1 2026-02-17T11:14:40.501 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:14:40.502 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:14:40.502 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:14:40.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 1 = 1 2026-02-17T11:14:40.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T11:14:40.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T11:14:40.759 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:104: TEST_divergent: get_pg test existing_1 2026-02-17T11:14:40.759 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1093: get_pg: local poolname=test 2026-02-17T11:14:40.759 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1094: get_pg: local objectname=existing_1 2026-02-17T11:14:40.760 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: ceph --format json osd map test existing_1 2026-02-17T11:14:40.760 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: jq -r .pgid 2026-02-17T11:14:40.958 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:104: TEST_divergent: local pgid=1.0 2026-02-17T11:14:40.959 INFO:tasks.workunit.client.0.trial148.stdout:blackholing osds 0 2 2026-02-17T11:14:40.960 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:107: TEST_divergent: echo 'blackholing osds 0 2' 2026-02-17T11:14:40.960 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph pg dump pgs 2026-02-17T11:14:41.146 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:14:41.146 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 0 0 0 69500 0 0 16 84 16 active+clean 2026-02-17T11:14:26.551463+0000 29'100 29:129 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:14:26.288530+0000 0'0 2026-02-17T11:14:26.288530+0000 0 0 periodic scrub scheduled @ 2026-02-18T20:07:06.757334+0000 0 0 2026-02-17T11:14:41.146 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:14:41.146 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:14:41.147 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:14:41.156 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:109: TEST_divergent: for i in $non_divergent 2026-02-17T11:14:41.157 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: get_asok_path osd.0 2026-02-17T11:14:41.158 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T11:14:41.158 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T11:14:41.158 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:14:41.158 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:14:41.158 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:14:41.159 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.0.asok 2026-02-17T11:14:41.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: CEPH_ARGS= 2026-02-17T11:14:41.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-17T11:14:41.221 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:14:41.221 INFO:tasks.workunit.client.0.trial148.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T11:14:41.221 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:14:41.227 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:109: TEST_divergent: for i in $non_divergent 2026-02-17T11:14:41.228 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: get_asok_path osd.2 2026-02-17T11:14:41.228 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2026-02-17T11:14:41.228 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2026-02-17T11:14:41.228 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:14:41.229 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:14:41.229 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:14:41.229 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.2.asok 2026-02-17T11:14:41.229 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: CEPH_ARGS= 2026-02-17T11:14:41.229 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-17T11:14:41.282 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:14:41.282 INFO:tasks.workunit.client.0.trial148.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T11:14:41.282 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:14:41.287 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:114: TEST_divergent: local case5=100 2026-02-17T11:14:41.288 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:115: TEST_divergent: expr 100 - 1 2026-02-17T11:14:41.289 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:115: TEST_divergent: local case3=99 2026-02-17T11:14:41.289 INFO:tasks.workunit.client.0.trial148.stdout:writing divergent object 2026-02-17T11:14:41.289 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:117: TEST_divergent: echo 'writing divergent object' 2026-02-17T11:14:41.290 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:119: TEST_divergent: echo 'create missing divergent object' 2026-02-17T11:14:41.290 INFO:tasks.workunit.client.0.trial148.stdout:create missing divergent object 2026-02-17T11:14:41.292 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:120: TEST_divergent: inject_eio rep data test existing_99 td/divergent-priors 0 2026-02-17T11:14:41.293 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2457: inject_eio: local pooltype=rep 2026-02-17T11:14:41.293 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2458: inject_eio: shift 2026-02-17T11:14:41.293 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2459: inject_eio: local which=data 2026-02-17T11:14:41.293 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2460: inject_eio: shift 2026-02-17T11:14:41.293 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:118: TEST_divergent: rados -p test put existing_100 /etc/fstab 2026-02-17T11:14:41.293 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2461: inject_eio: local poolname=test 2026-02-17T11:14:41.293 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2462: inject_eio: shift 2026-02-17T11:14:41.293 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2463: inject_eio: local objname=existing_99 2026-02-17T11:14:41.293 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2464: inject_eio: shift 2026-02-17T11:14:41.293 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2465: inject_eio: local dir=td/divergent-priors 2026-02-17T11:14:41.294 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2466: inject_eio: shift 2026-02-17T11:14:41.294 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2467: inject_eio: local shard_id=0 2026-02-17T11:14:41.294 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2468: inject_eio: shift 2026-02-17T11:14:41.294 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: get_osds test existing_99 2026-02-17T11:14:41.294 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1021: get_osds: local poolname=test 2026-02-17T11:14:41.294 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1022: get_osds: local objectname=existing_99 2026-02-17T11:14:41.294 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: ceph --format json osd map test existing_99 2026-02-17T11:14:41.294 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: jq '.acting | .[]' 2026-02-17T11:14:41.500 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1025: get_osds: local 'osds=1 2026-02-17T11:14:41.500 INFO:tasks.workunit.client.0.trial148.stderr:0 2026-02-17T11:14:41.500 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:14:41.500 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1027: get_osds: echo 1 0 2 2026-02-17T11:14:41.500 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: initial_osds=('1' '0' '2') 2026-02-17T11:14:41.501 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2470: inject_eio: local -a initial_osds 2026-02-17T11:14:41.501 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2471: inject_eio: local osd_id=1 2026-02-17T11:14:41.501 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2472: inject_eio: '[' rep '!=' ec ']' 2026-02-17T11:14:41.501 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2473: inject_eio: shard_id= 2026-02-17T11:14:41.501 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: cat td/divergent-priors/1/type 2026-02-17T11:14:41.503 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2475: inject_eio: type=bluestore 2026-02-17T11:14:41.503 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2476: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-17T11:14:41.503 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1161: set_config: local daemon=osd 2026-02-17T11:14:41.504 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1162: set_config: local id=1 2026-02-17T11:14:41.504 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1163: set_config: local config=bluestore_debug_inject_read_err 2026-02-17T11:14:41.504 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1164: set_config: local value=true 2026-02-17T11:14:41.504 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: jq 'has("success")' 2026-02-17T11:14:41.504 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: get_asok_path osd.1 2026-02-17T11:14:41.504 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T11:14:41.504 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T11:14:41.504 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:14:41.504 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:14:41.504 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:14:41.505 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.1.asok 2026-02-17T11:14:41.505 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.19803/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-17T11:14:41.562 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1168: set_config: test true == true 2026-02-17T11:14:41.562 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2477: inject_eio: local loop=0 2026-02-17T11:14:41.564 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2479: inject_eio: grep -q Invalid 2026-02-17T11:14:41.564 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: get_asok_path osd.1 2026-02-17T11:14:41.564 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T11:14:41.564 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T11:14:41.565 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:14:41.565 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:14:41.565 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:14:41.565 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.1.asok 2026-02-17T11:14:41.565 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: CEPH_ARGS= 2026-02-17T11:14:41.565 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2478: inject_eio: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.1.asok injectdataerr test existing_99 2026-02-17T11:14:41.620 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:122: TEST_divergent: sleep 10 2026-02-17T11:14:41.620 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:121: TEST_divergent: rados -p test get existing_99 td/divergent-priors/existing 2026-02-17T11:14:51.621 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:123: TEST_divergent: killall -9 rados 2026-02-17T11:14:51.664 INFO:tasks.workunit.client.0.trial148.stderr:rados: no process found 2026-02-17T11:14:51.665 INFO:tasks.workunit.client.0.trial148.stdout:killing all the osds 2026-02-17T11:14:51.665 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: echo 'killing all the osds' 2026-02-17T11:14:51.666 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:127: TEST_divergent: ceph pg dump pgs 2026-02-17T11:14:51.871 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:14:51.871 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 0 0 0 69500 0 0 17 84 17 active+clean 2026-02-17T11:14:41.638235+0000 29'101 29:138 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:14:26.288530+0000 0'0 2026-02-17T11:14:26.288530+0000 0 0 periodic scrub scheduled @ 2026-02-18T20:07:06.757334+0000 0 0 2026-02-17T11:14:51.871 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:14:51.871 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:14:51.871 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:14:51.879 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: kill_daemons td/divergent-priors KILL osd 2026-02-17T11:14:51.880 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:14:51.880 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:14:51.880 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:14:51.880 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:14:51.880 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:14:51.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:14:51.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:129: TEST_divergent: for i in $osds 2026-02-17T11:14:51.990 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:131: TEST_divergent: ceph osd down osd.0 2026-02-17T11:14:52.238 INFO:tasks.workunit.client.0.trial148.stderr:osd.0 is already down. 2026-02-17T11:14:52.247 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:129: TEST_divergent: for i in $osds 2026-02-17T11:14:52.247 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:131: TEST_divergent: ceph osd down osd.1 2026-02-17T11:14:52.509 INFO:tasks.workunit.client.0.trial148.stderr:osd.1 is already down. 2026-02-17T11:14:52.518 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:129: TEST_divergent: for i in $osds 2026-02-17T11:14:52.519 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:131: TEST_divergent: ceph osd down osd.2 2026-02-17T11:14:52.781 INFO:tasks.workunit.client.0.trial148.stderr:osd.2 is already down. 2026-02-17T11:14:52.790 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:133: TEST_divergent: for i in $non_divergent 2026-02-17T11:14:52.790 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:135: TEST_divergent: ceph osd out osd.0 2026-02-17T11:14:53.059 INFO:tasks.workunit.client.0.trial148.stderr:osd.0 is already out. 2026-02-17T11:14:53.071 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:133: TEST_divergent: for i in $non_divergent 2026-02-17T11:14:53.071 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:135: TEST_divergent: ceph osd out osd.2 2026-02-17T11:14:53.327 INFO:tasks.workunit.client.0.trial148.stderr:osd.2 is already out. 2026-02-17T11:14:53.338 INFO:tasks.workunit.client.0.trial148.stdout:bringing up non_divergent 0 2 2026-02-17T11:14:53.339 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:139: TEST_divergent: echo 'bringing up non_divergent 0 2' 2026-02-17T11:14:53.339 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: ceph pg dump pgs 2026-02-17T11:14:53.528 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:14:53.528 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 0 0 0 69500 0 0 17 84 17 stale+active+clean 2026-02-17T11:14:41.638235+0000 29'101 29:138 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:14:26.288530+0000 0'0 2026-02-17T11:14:26.288530+0000 0 0 periodic scrub scheduled @ 2026-02-18T20:07:06.757334+0000 0 0 2026-02-17T11:14:53.528 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:14:53.528 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:14:53.528 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:14:53.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:141: TEST_divergent: for i in $non_divergent 2026-02-17T11:14:53.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:143: TEST_divergent: activate_osd td/divergent-priors 0 2026-02-17T11:14:53.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/divergent-priors 2026-02-17T11:14:53.540 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:14:53.540 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=0 2026-02-17T11:14:53.540 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:14:53.540 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T11:14:53.540 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:14:53.540 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:14:53.540 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:14:53.540 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:14:53.540 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T11:14:53.540 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T11:14:53.540 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:14:53.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:14:53.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:14:53.541 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:14:53.541 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:14:53.541 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:14:53.541 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:14:53.541 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:14:53.541 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:14:53.541 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:14:53.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:14:53.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:14:53.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:14:53.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:14:53.542 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:14:53.542 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:14:53.542 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:14:53.542 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:14:53.542 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:14:53.542 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:14:53.542 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T11:14:53.543 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.0 2026-02-17T11:14:53.543 INFO:tasks.workunit.client.0.trial148.stdout:start osd.0 2026-02-17T11:14:53.544 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 0 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:14:53.544 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T11:14:53.544 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 0 = 0 ']' 2026-02-17T11:14:53.544 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:14:53.544 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:14:53.544 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:14:53.566 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:53.557+0000 7fe9eff308c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:53.567 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:53.557+0000 7fe9eff308c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:53.569 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:53.561+0000 7fe9eff308c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:53.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 0 2026-02-17T11:14:53.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:14:53.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T11:14:53.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:14:53.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:14:53.749 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:53.749 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:14:53.749 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:14:53.749 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:53.750 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:14:53.952 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:14:54.809 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:54.801+0000 7fe9eff308c0 -1 Falling back to public interface 2026-02-17T11:14:54.953 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:14:54.953 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:54.953 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:14:54.953 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:14:54.953 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:54.954 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:14:55.153 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:14:56.155 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:14:56.155 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:56.155 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:14:56.156 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:14:56.156 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:56.156 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:14:56.356 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:14:57.357 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:14:57.357 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:57.358 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:14:57.358 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:14:57.358 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:57.358 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:14:57.554 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:14:57.854 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:57.844+0000 7fe9eff308c0 -1 osd.0 29 log_to_monitors true 2026-02-17T11:14:58.555 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:14:58.556 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:58.556 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:14:58.556 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:14:58.557 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:58.557 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:14:58.755 INFO:tasks.workunit.client.0.trial148.stdout:osd.0 up out weight 0 up_from 36 up_thru 0 down_at 30 last_clean_interval [5,29) [v2:127.0.0.1:6802/2257203782,v1:127.0.0.1:6803/2257203782] [v2:127.0.0.1:6804/2257203782,v1:127.0.0.1:6805/2257203782] exists,up 951a1d3e-5227-4925-8600-0a5d6411bee8 2026-02-17T11:14:58.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:14:58.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:14:58.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:14:58.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:141: TEST_divergent: for i in $non_divergent 2026-02-17T11:14:58.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:143: TEST_divergent: activate_osd td/divergent-priors 2 2026-02-17T11:14:58.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/divergent-priors 2026-02-17T11:14:58.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:14:58.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T11:14:58.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:14:58.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T11:14:58.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:14:58.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:14:58.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:14:58.760 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:14:58.760 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T11:14:58.760 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T11:14:58.760 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:14:58.760 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:14:58.760 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:14:58.760 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:14:58.760 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:14:58.760 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:14:58.761 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:14:58.761 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:14:58.761 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:14:58.761 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:14:58.761 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:14:58.761 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:14:58.761 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:14:58.761 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:14:58.762 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:14:58.762 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:14:58.762 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:14:58.762 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:14:58.762 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:14:58.762 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:14:58.762 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T11:14:58.762 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T11:14:58.763 INFO:tasks.workunit.client.0.trial148.stdout:start osd.2 2026-02-17T11:14:58.764 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:14:58.764 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T11:14:58.764 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T11:14:58.764 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:14:58.764 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:14:58.764 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:14:58.779 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:58.768+0000 7ff3dccc08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:58.780 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:58.772+0000 7ff3dccc08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:58.781 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:14:58.772+0000 7ff3dccc08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:14:58.966 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T11:14:58.966 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:14:58.966 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T11:14:58.966 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:14:58.966 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:14:58.966 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:14:58.967 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:14:58.967 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:14:58.967 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:14:58.967 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:14:59.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:15:00.045 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:15:00.036+0000 7ff3dccc08c0 -1 Falling back to public interface 2026-02-17T11:15:00.167 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:15:00.167 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:15:00.167 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:15:00.167 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:15:00.168 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:15:00.168 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:15:00.365 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:15:01.366 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:15:01.367 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:15:01.367 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:15:01.368 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:15:01.368 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:15:01.368 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:15:01.567 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:15:02.569 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:15:02.569 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:15:02.569 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:15:02.569 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:15:02.570 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:15:02.570 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:15:02.768 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:15:03.125 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:15:03.116+0000 7ff3dccc08c0 -1 osd.2 29 log_to_monitors true 2026-02-17T11:15:03.769 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:15:03.769 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:15:03.770 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:15:03.770 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:15:03.771 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:15:03.771 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:15:03.964 INFO:tasks.workunit.client.0.trial148.stdout:osd.2 up out weight 0 up_from 38 up_thru 0 down_at 32 last_clean_interval [13,29) [v2:127.0.0.1:6810/2900727382,v1:127.0.0.1:6811/2900727382] [v2:127.0.0.1:6812/2900727382,v1:127.0.0.1:6813/2900727382] exists,up fc05ccb6-8c79-4405-8211-08924f11237c 2026-02-17T11:15:03.964 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:15:03.964 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:15:03.964 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:15:03.965 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:145: TEST_divergent: for i in $non_divergent 2026-02-17T11:15:03.965 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: ceph osd in osd.0 2026-02-17T11:15:04.213 INFO:tasks.workunit.client.0.trial148.stderr:osd.0 is already in. 2026-02-17T11:15:04.222 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:145: TEST_divergent: for i in $non_divergent 2026-02-17T11:15:04.222 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: ceph osd in osd.2 2026-02-17T11:15:04.481 INFO:tasks.workunit.client.0.trial148.stderr:osd.2 is already in. 2026-02-17T11:15:04.490 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T11:15:04.490 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: wait_for_clean 2026-02-17T11:15:04.490 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T11:15:04.490 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T11:15:04.490 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T11:15:04.491 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T11:15:04.491 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T11:15:04.491 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T11:15:04.492 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T11:15:04.492 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T11:15:04.492 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T11:15:04.556 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T11:15:04.557 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T11:15:04.557 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T11:15:04.557 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T11:15:04.557 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:15:04.557 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:15:04.766 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:15:04.767 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:15:04.767 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:15:04.767 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:15:04.767 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:15:04.767 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:15:04.845 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=154618822660 2026-02-17T11:15:04.846 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 154618822660 2026-02-17T11:15:04.846 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-154618822660' 2026-02-17T11:15:04.846 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:15:04.846 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:15:04.907 INFO:tasks.workunit.client.0.trial148.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-17T11:15:04.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq= 2026-02-17T11:15:04.909 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z '' 2026-02-17T11:15:04.909 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: continue 2026-02-17T11:15:04.909 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:15:04.909 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:15:04.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=163208757251 2026-02-17T11:15:04.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 163208757251 2026-02-17T11:15:04.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-154618822660 2-163208757251' 2026-02-17T11:15:04.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:15:04.990 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-154618822660 2026-02-17T11:15:04.990 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:15:04.990 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:15:04.991 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-154618822660 2026-02-17T11:15:04.991 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:15:04.993 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=154618822660 2026-02-17T11:15:04.993 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 154618822660' 2026-02-17T11:15:04.993 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 154618822660 2026-02-17T11:15:04.993 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:15:05.198 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 154618822658 -lt 154618822660 2026-02-17T11:15:05.198 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:15:06.199 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:15:06.199 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:15:06.399 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 154618822658 -lt 154618822660 2026-02-17T11:15:06.400 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:15:07.401 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T11:15:07.402 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:15:07.609 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 154618822660 -lt 154618822660 2026-02-17T11:15:07.609 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:15:07.610 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-163208757251 2026-02-17T11:15:07.610 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:15:07.611 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:15:07.612 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-163208757251 2026-02-17T11:15:07.612 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:15:07.613 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=163208757251 2026-02-17T11:15:07.613 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 163208757251' 2026-02-17T11:15:07.613 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 163208757251 2026-02-17T11:15:07.613 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:15:07.820 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-17T11:15:07.821 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T11:15:07.821 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:15:07.821 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:15:08.076 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 == 0 2026-02-17T11:15:08.076 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:15:08.076 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:15:08.077 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:15:08.077 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:15:08.077 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:15:08.077 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:15:08.077 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:15:08.273 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:15:08.274 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:15:08.274 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:15:08.274 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:15:08.540 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:15:08.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' -1 2026-02-17T11:15:08.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: loop=0 2026-02-17T11:15:08.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: num_active_clean=0 2026-02-17T11:15:08.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:15:08.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.1 2026-02-17T11:15:08.641 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:15:08.641 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:15:08.641 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:15:08.641 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:15:08.641 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:15:08.642 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:15:08.643 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:15:08.643 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:15:08.838 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:15:08.839 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:15:08.839 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:15:08.839 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:15:09.101 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:15:09.102 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:15:09.102 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:15:09.102 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:15:09.102 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:15:09.102 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:15:09.102 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:15:09.102 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:15:09.102 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:15:09.366 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:15:09.366 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:15:09.366 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 1 >= 8 )) 2026-02-17T11:15:09.366 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:15:09.367 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.2 2026-02-17T11:15:09.566 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:15:09.566 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:15:09.566 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:15:09.567 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:15:09.567 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:15:09.567 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:15:09.567 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:15:09.567 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:15:09.768 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:15:09.768 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:15:09.768 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:15:09.769 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:15:10.033 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:15:10.033 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:15:10.033 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:15:10.033 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:15:10.034 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:15:10.034 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:15:10.034 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:15:10.034 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:15:10.034 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:15:10.295 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:15:10.296 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:15:10.296 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 2 >= 8 )) 2026-02-17T11:15:10.296 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:15:10.296 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.4 2026-02-17T11:15:10.696 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:15:10.697 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:15:10.697 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:15:10.697 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:15:10.697 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:15:10.697 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:15:10.698 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:15:10.698 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:15:10.907 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:15:10.908 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:15:10.908 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:15:10.908 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:15:11.180 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:15:11.180 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:15:11.181 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:15:11.181 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:15:11.181 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:15:11.181 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:15:11.181 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:15:11.181 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:15:11.181 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:15:11.444 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:15:11.445 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:15:11.445 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 3 >= 8 )) 2026-02-17T11:15:11.445 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:15:11.445 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.8 2026-02-17T11:15:12.245 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:15:12.245 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:15:12.245 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:15:12.245 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:15:12.245 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:15:12.245 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:15:12.246 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:15:12.246 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:15:12.449 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:15:12.450 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:15:12.450 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:15:12.450 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:15:12.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:15:12.722 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:15:12.722 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:15:12.722 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:15:12.722 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:15:12.722 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:15:12.722 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:15:12.722 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:15:12.722 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:15:12.985 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:15:12.985 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:15:12.985 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 4 >= 8 )) 2026-02-17T11:15:12.985 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:15:12.986 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 1.6 2026-02-17T11:15:14.587 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:15:14.587 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:15:14.588 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:15:14.589 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:15:14.589 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:15:14.589 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:15:14.589 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:15:14.589 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:15:14.784 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:15:14.784 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:15:14.784 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:15:14.785 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:15:15.045 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:15:15.045 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:15:15.045 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:15:15.045 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:15:15.045 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:15:15.046 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:15:15.046 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:15:15.046 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:15:15.046 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:15:15.301 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:15:15.301 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:15:15.302 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 5 >= 8 )) 2026-02-17T11:15:15.302 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:15:15.302 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 3.2 2026-02-17T11:15:18.503 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:15:18.503 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:15:18.504 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:15:18.505 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:15:18.505 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:15:18.505 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:15:18.505 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:15:18.505 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:15:18.702 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:15:18.702 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:15:18.702 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:15:18.703 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:15:18.961 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:15:18.961 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:15:18.962 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:15:18.962 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:15:18.962 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:15:18.962 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:15:18.962 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:15:18.962 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:15:18.962 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:15:19.223 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:15:19.223 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:15:19.223 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 6 >= 8 )) 2026-02-17T11:15:19.223 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:15:19.223 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 6.4 2026-02-17T11:15:25.625 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:15:25.625 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:15:25.626 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:15:25.626 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:15:25.626 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:15:25.627 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:15:25.627 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:15:25.627 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:15:25.819 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:15:25.819 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:15:25.819 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:15:25.819 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:15:26.076 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:15:26.076 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:15:26.076 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:15:26.076 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:15:26.077 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:15:26.077 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:15:26.077 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:15:26.077 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:15:26.077 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:15:26.333 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:15:26.334 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:15:26.334 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 7 >= 8 )) 2026-02-17T11:15:26.334 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:15:26.334 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 7.3 2026-02-17T11:15:33.635 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:15:33.635 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:15:33.636 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:15:33.636 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:15:33.636 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:15:33.636 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:15:33.636 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:15:33.636 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:15:33.840 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:15:33.841 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:15:33.841 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:15:33.841 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:15:34.113 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:15:34.113 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:15:34.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:15:34.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:15:34.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:15:34.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:15:34.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:15:34.114 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:15:34.114 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:15:34.379 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:15:34.379 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:15:34.379 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 8 >= 8 )) 2026-02-17T11:15:34.379 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1679: wait_for_clean: ceph report 2026-02-17T11:15:34.640 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:15:34.640 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_fingerprint": "5b92ee93-aaa1-4c0f-8de9-e4f6f73524be", 2026-02-17T11:15:34.640 INFO:tasks.workunit.client.0.trial148.stdout: "version": "19.2.3-705-g04cf6dd4", 2026-02-17T11:15:34.640 INFO:tasks.workunit.client.0.trial148.stdout: "commit": "04cf6dd4be446d06026adad18a5fbf5da1fa8c0e", 2026-02-17T11:15:34.640 INFO:tasks.workunit.client.0.trial148.stdout: "timestamp": "2026-02-17T11:15:34.632111+0000", 2026-02-17T11:15:34.640 INFO:tasks.workunit.client.0.trial148.stdout: "tag": "", 2026-02-17T11:15:34.640 INFO:tasks.workunit.client.0.trial148.stdout: "health": { 2026-02-17T11:15:34.640 INFO:tasks.workunit.client.0.trial148.stdout: "status": "HEALTH_WARN", 2026-02-17T11:15:34.641 INFO:tasks.workunit.client.0.trial148.stdout: "checks": { 2026-02-17T11:15:34.641 INFO:tasks.workunit.client.0.trial148.stdout: "OSDMAP_FLAGS": { 2026-02-17T11:15:34.641 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:15:34.641 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:15:34.641 INFO:tasks.workunit.client.0.trial148.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T11:15:34.641 INFO:tasks.workunit.client.0.trial148.stdout: "count": 17 2026-02-17T11:15:34.641 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.641 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [], 2026-02-17T11:15:34.641 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:15:34.641 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.641 INFO:tasks.workunit.client.0.trial148.stdout: "OSD_DOWN": { 2026-02-17T11:15:34.641 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:15:34.642 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:15:34.642 INFO:tasks.workunit.client.0.trial148.stdout: "message": "1 osds down", 2026-02-17T11:15:34.642 INFO:tasks.workunit.client.0.trial148.stdout: "count": 1 2026-02-17T11:15:34.642 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.642 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:15:34.642 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.642 INFO:tasks.workunit.client.0.trial148.stdout: "message": "osd.1 (root=default,host=trial148) is down" 2026-02-17T11:15:34.642 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.642 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:15:34.642 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:15:34.643 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.643 INFO:tasks.workunit.client.0.trial148.stdout: "PG_DEGRADED": { 2026-02-17T11:15:34.643 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:15:34.643 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:15:34.643 INFO:tasks.workunit.client.0.trial148.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-17T11:15:34.643 INFO:tasks.workunit.client.0.trial148.stdout: "count": 1 2026-02-17T11:15:34.643 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.643 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:15:34.643 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.643 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:15:34.643 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.643 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:15:34.644 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:15:34.644 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.644 INFO:tasks.workunit.client.0.trial148.stdout: "POOL_APP_NOT_ENABLED": { 2026-02-17T11:15:34.644 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:15:34.644 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:15:34.644 INFO:tasks.workunit.client.0.trial148.stdout: "message": "1 pool(s) do not have an application enabled", 2026-02-17T11:15:34.644 INFO:tasks.workunit.client.0.trial148.stdout: "count": 1 2026-02-17T11:15:34.644 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.644 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:15:34.644 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.644 INFO:tasks.workunit.client.0.trial148.stdout: "message": "application not enabled on pool 'test'" 2026-02-17T11:15:34.644 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.645 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.645 INFO:tasks.workunit.client.0.trial148.stdout: "message": "use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." 2026-02-17T11:15:34.645 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.645 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:15:34.645 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:15:34.645 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.645 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.645 INFO:tasks.workunit.client.0.trial148.stdout: "mutes": [] 2026-02-17T11:15:34.645 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.645 INFO:tasks.workunit.client.0.trial148.stdout: "monmap_first_committed": 1, 2026-02-17T11:15:34.645 INFO:tasks.workunit.client.0.trial148.stdout: "monmap_last_committed": 1, 2026-02-17T11:15:34.645 INFO:tasks.workunit.client.0.trial148.stdout: "monmap": { 2026-02-17T11:15:34.646 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 1, 2026-02-17T11:15:34.646 INFO:tasks.workunit.client.0.trial148.stdout: "fsid": "0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a", 2026-02-17T11:15:34.646 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:13:58.162351Z", 2026-02-17T11:15:34.646 INFO:tasks.workunit.client.0.trial148.stdout: "created": "2026-02-17T11:13:58.162351Z", 2026-02-17T11:15:34.646 INFO:tasks.workunit.client.0.trial148.stdout: "min_mon_release": 19, 2026-02-17T11:15:34.646 INFO:tasks.workunit.client.0.trial148.stdout: "min_mon_release_name": "squid", 2026-02-17T11:15:34.646 INFO:tasks.workunit.client.0.trial148.stdout: "election_strategy": 1, 2026-02-17T11:15:34.646 INFO:tasks.workunit.client.0.trial148.stdout: "disallowed_leaders": "", 2026-02-17T11:15:34.646 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode": false, 2026-02-17T11:15:34.646 INFO:tasks.workunit.client.0.trial148.stdout: "tiebreaker_mon": "", 2026-02-17T11:15:34.646 INFO:tasks.workunit.client.0.trial148.stdout: "removed_ranks": "", 2026-02-17T11:15:34.646 INFO:tasks.workunit.client.0.trial148.stdout: "features": { 2026-02-17T11:15:34.647 INFO:tasks.workunit.client.0.trial148.stdout: "persistent": [ 2026-02-17T11:15:34.647 INFO:tasks.workunit.client.0.trial148.stdout: "kraken", 2026-02-17T11:15:34.647 INFO:tasks.workunit.client.0.trial148.stdout: "luminous", 2026-02-17T11:15:34.647 INFO:tasks.workunit.client.0.trial148.stdout: "mimic", 2026-02-17T11:15:34.647 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap-prune", 2026-02-17T11:15:34.647 INFO:tasks.workunit.client.0.trial148.stdout: "nautilus", 2026-02-17T11:15:34.647 INFO:tasks.workunit.client.0.trial148.stdout: "octopus", 2026-02-17T11:15:34.647 INFO:tasks.workunit.client.0.trial148.stdout: "pacific", 2026-02-17T11:15:34.647 INFO:tasks.workunit.client.0.trial148.stdout: "elector-pinging", 2026-02-17T11:15:34.647 INFO:tasks.workunit.client.0.trial148.stdout: "quincy", 2026-02-17T11:15:34.647 INFO:tasks.workunit.client.0.trial148.stdout: "reef", 2026-02-17T11:15:34.647 INFO:tasks.workunit.client.0.trial148.stdout: "squid" 2026-02-17T11:15:34.648 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:15:34.648 INFO:tasks.workunit.client.0.trial148.stdout: "optional": [] 2026-02-17T11:15:34.648 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.648 INFO:tasks.workunit.client.0.trial148.stdout: "mons": [ 2026-02-17T11:15:34.648 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.648 INFO:tasks.workunit.client.0.trial148.stdout: "rank": 0, 2026-02-17T11:15:34.648 INFO:tasks.workunit.client.0.trial148.stdout: "name": "a", 2026-02-17T11:15:34.648 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:15:34.648 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:15:34.648 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.648 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:15:34.648 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:7115", 2026-02-17T11:15:34.649 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 0 2026-02-17T11:15:34.649 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.649 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.649 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.649 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T11:15:34.649 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T11:15:34.649 INFO:tasks.workunit.client.0.trial148.stdout: "priority": 0, 2026-02-17T11:15:34.649 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 0, 2026-02-17T11:15:34.649 INFO:tasks.workunit.client.0.trial148.stdout: "crush_location": "{}" 2026-02-17T11:15:34.649 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.649 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.649 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.650 INFO:tasks.workunit.client.0.trial148.stdout: "quorum": [ 2026-02-17T11:15:34.650 INFO:tasks.workunit.client.0.trial148.stdout: 0 2026-02-17T11:15:34.650 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:15:34.650 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap": { 2026-02-17T11:15:34.650 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 41, 2026-02-17T11:15:34.650 INFO:tasks.workunit.client.0.trial148.stdout: "fsid": "0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a", 2026-02-17T11:15:34.650 INFO:tasks.workunit.client.0.trial148.stdout: "created": "2026-02-17T11:13:58.239607+0000", 2026-02-17T11:15:34.650 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:15:04.524700+0000", 2026-02-17T11:15:34.650 INFO:tasks.workunit.client.0.trial148.stdout: "last_up_change": "2026-02-17T11:15:03.274367+0000", 2026-02-17T11:15:34.650 INFO:tasks.workunit.client.0.trial148.stdout: "last_in_change": "2026-02-17T11:15:04.422534+0000", 2026-02-17T11:15:34.650 INFO:tasks.workunit.client.0.trial148.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T11:15:34.650 INFO:tasks.workunit.client.0.trial148.stdout: "flags_num": 5800384, 2026-02-17T11:15:34.650 INFO:tasks.workunit.client.0.trial148.stdout: "flags_set": [ 2026-02-17T11:15:34.650 INFO:tasks.workunit.client.0.trial148.stdout: "nodown", 2026-02-17T11:15:34.650 INFO:tasks.workunit.client.0.trial148.stdout: "noin", 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "noout", 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "pglog_hardlimit", 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snapdirs", 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "recovery_deletes", 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "sortbitwise" 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "crush_version": 9, 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_snapshot": "", 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "pool_max": 1, 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "max_osd": 3, 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "require_min_compat_client": "luminous", 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "min_compat_client": "jewel", 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "require_osd_release": "squid", 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "allow_crimson": false, 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "pools": [ 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "pool": 1, 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "pool_name": "test", 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "create_time": "2026-02-17T11:14:26.251332+0000", 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "flags": 1, 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "flags_names": "hashpspool", 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "type": 1, 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "size": 3, 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "min_size": 2, 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "crush_rule": 0, 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_count": 0, 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_target": 0, 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "is_stretch_pool": false, 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "object_hash": 2, 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "pg_autoscale_mode": "off", 2026-02-17T11:15:34.651 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num": 1, 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "pg_placement_num": 1, 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "pg_placement_num_target": 1, 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num_target": 1, 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num_pending": 1, 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "last_pg_merge_meta": { 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "source_pgid": "0.0", 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "ready_epoch": 0, 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_started": 0, 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_clean": 0, 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "source_version": "0'0", 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "target_version": "0'0" 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "last_change": "26", 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend": "0", 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "auid": 0, 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "snap_mode": "selfmanaged", 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "snap_seq": 0, 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "snap_epoch": 0, 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "pool_snaps": [], 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "removed_snaps": "[]", 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "quota_max_bytes": 0, 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "quota_max_objects": 0, 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "tiers": [], 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "tier_of": -1, 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "read_tier": -1, 2026-02-17T11:15:34.652 INFO:tasks.workunit.client.0.trial148.stdout: "write_tier": -1, 2026-02-17T11:15:34.653 INFO:tasks.workunit.client.0.trial148.stdout: "cache_mode": "none", 2026-02-17T11:15:34.653 INFO:tasks.workunit.client.0.trial148.stdout: "target_max_bytes": 0, 2026-02-17T11:15:34.653 INFO:tasks.workunit.client.0.trial148.stdout: "target_max_objects": 0, 2026-02-17T11:15:34.653 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T11:15:34.653 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T11:15:34.653 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T11:15:34.653 INFO:tasks.workunit.client.0.trial148.stdout: "cache_min_flush_age": 0, 2026-02-17T11:15:34.653 INFO:tasks.workunit.client.0.trial148.stdout: "cache_min_evict_age": 0, 2026-02-17T11:15:34.653 INFO:tasks.workunit.client.0.trial148.stdout: "erasure_code_profile": "", 2026-02-17T11:15:34.653 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_params": { 2026-02-17T11:15:34.653 INFO:tasks.workunit.client.0.trial148.stdout: "type": "none" 2026-02-17T11:15:34.653 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.653 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_period": 0, 2026-02-17T11:15:34.654 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_count": 0, 2026-02-17T11:15:34.654 INFO:tasks.workunit.client.0.trial148.stdout: "use_gmt_hitset": true, 2026-02-17T11:15:34.654 INFO:tasks.workunit.client.0.trial148.stdout: "min_read_recency_for_promote": 0, 2026-02-17T11:15:34.654 INFO:tasks.workunit.client.0.trial148.stdout: "min_write_recency_for_promote": 0, 2026-02-17T11:15:34.654 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T11:15:34.654 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_search_last_n": 0, 2026-02-17T11:15:34.654 INFO:tasks.workunit.client.0.trial148.stdout: "grade_table": [], 2026-02-17T11:15:34.654 INFO:tasks.workunit.client.0.trial148.stdout: "stripe_width": 0, 2026-02-17T11:15:34.654 INFO:tasks.workunit.client.0.trial148.stdout: "expected_num_objects": 0, 2026-02-17T11:15:34.654 INFO:tasks.workunit.client.0.trial148.stdout: "fast_read": false, 2026-02-17T11:15:34.654 INFO:tasks.workunit.client.0.trial148.stdout: "options": {}, 2026-02-17T11:15:34.654 INFO:tasks.workunit.client.0.trial148.stdout: "application_metadata": {}, 2026-02-17T11:15:34.654 INFO:tasks.workunit.client.0.trial148.stdout: "read_balance": { 2026-02-17T11:15:34.655 INFO:tasks.workunit.client.0.trial148.stdout: "score_type": "Fair distribution", 2026-02-17T11:15:34.655 INFO:tasks.workunit.client.0.trial148.stdout: "score_acting": 2.9900000095367432, 2026-02-17T11:15:34.655 INFO:tasks.workunit.client.0.trial148.stdout: "score_stable": 2.9900000095367432, 2026-02-17T11:15:34.655 INFO:tasks.workunit.client.0.trial148.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T11:15:34.655 INFO:tasks.workunit.client.0.trial148.stdout: "raw_score_acting": 2, 2026-02-17T11:15:34.655 INFO:tasks.workunit.client.0.trial148.stdout: "raw_score_stable": 2, 2026-02-17T11:15:34.655 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity_weighted": 1, 2026-02-17T11:15:34.655 INFO:tasks.workunit.client.0.trial148.stdout: "average_primary_affinity": 1, 2026-02-17T11:15:34.655 INFO:tasks.workunit.client.0.trial148.stdout: "average_primary_affinity_weighted": 1 2026-02-17T11:15:34.655 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.655 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.655 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:15:34.656 INFO:tasks.workunit.client.0.trial148.stdout: "osds": [ 2026-02-17T11:15:34.656 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.656 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:15:34.656 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "951a1d3e-5227-4925-8600-0a5d6411bee8", 2026-02-17T11:15:34.656 INFO:tasks.workunit.client.0.trial148.stdout: "up": 1, 2026-02-17T11:15:34.656 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:15:34.656 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:15:34.656 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:15:34.656 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 5, 2026-02-17T11:15:34.656 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 29, 2026-02-17T11:15:34.656 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 36, 2026-02-17T11:15:34.656 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 40, 2026-02-17T11:15:34.656 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 30, 2026-02-17T11:15:34.657 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:15:34.657 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:15:34.657 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:15:34.657 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.657 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:15:34.657 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6802", 2026-02-17T11:15:34.657 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2257203782 2026-02-17T11:15:34.657 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.657 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.657 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:15:34.657 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6803", 2026-02-17T11:15:34.657 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2257203782 2026-02-17T11:15:34.657 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.658 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.658 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.658 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:15:34.658 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:15:34.658 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.658 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:15:34.658 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6804", 2026-02-17T11:15:34.658 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2257203782 2026-02-17T11:15:34.658 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.658 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.658 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:15:34.658 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6805", 2026-02-17T11:15:34.658 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2257203782 2026-02-17T11:15:34.659 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.659 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.659 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.659 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:15:34.659 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:15:34.659 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.659 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:15:34.659 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6808", 2026-02-17T11:15:34.659 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2257203782 2026-02-17T11:15:34.659 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.659 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.659 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:15:34.659 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6809", 2026-02-17T11:15:34.660 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2257203782 2026-02-17T11:15:34.660 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.660 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.660 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.660 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:15:34.660 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:15:34.660 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.660 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:15:34.660 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6806", 2026-02-17T11:15:34.660 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2257203782 2026-02-17T11:15:34.660 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.660 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.661 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:15:34.661 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6807", 2026-02-17T11:15:34.661 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2257203782 2026-02-17T11:15:34.661 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.661 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.661 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.661 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6803/2257203782", 2026-02-17T11:15:34.661 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6805/2257203782", 2026-02-17T11:15:34.661 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6809/2257203782", 2026-02-17T11:15:34.661 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6807/2257203782", 2026-02-17T11:15:34.661 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:15:34.661 INFO:tasks.workunit.client.0.trial148.stdout: "exists", 2026-02-17T11:15:34.662 INFO:tasks.workunit.client.0.trial148.stdout: "up" 2026-02-17T11:15:34.662 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.662 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.662 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.662 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:15:34.662 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "793cab14-e8f0-48e0-b312-0d146e33192d", 2026-02-17T11:15:34.662 INFO:tasks.workunit.client.0.trial148.stdout: "up": 0, 2026-02-17T11:15:34.662 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:15:34.662 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:15:34.662 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:15:34.662 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 0, 2026-02-17T11:15:34.662 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 0, 2026-02-17T11:15:34.663 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 9, 2026-02-17T11:15:34.663 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 20, 2026-02-17T11:15:34.663 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 31, 2026-02-17T11:15:34.663 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:15:34.663 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:15:34.663 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:15:34.663 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.663 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:15:34.663 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6810", 2026-02-17T11:15:34.663 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2172046260 2026-02-17T11:15:34.663 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.663 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.663 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:15:34.664 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6811", 2026-02-17T11:15:34.664 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2172046260 2026-02-17T11:15:34.664 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.664 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.664 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.664 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:15:34.664 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:15:34.664 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.664 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:15:34.664 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6812", 2026-02-17T11:15:34.664 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2172046260 2026-02-17T11:15:34.664 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.665 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.665 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:15:34.665 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6813", 2026-02-17T11:15:34.665 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2172046260 2026-02-17T11:15:34.665 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.665 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.665 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.665 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:15:34.665 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:15:34.665 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.665 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:15:34.665 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6816", 2026-02-17T11:15:34.666 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2172046260 2026-02-17T11:15:34.666 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.666 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.666 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:15:34.666 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6817", 2026-02-17T11:15:34.666 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2172046260 2026-02-17T11:15:34.666 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.666 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.666 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.666 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:15:34.666 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:15:34.666 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.666 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:15:34.667 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6814", 2026-02-17T11:15:34.667 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2172046260 2026-02-17T11:15:34.667 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.667 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.667 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:15:34.667 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6815", 2026-02-17T11:15:34.667 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2172046260 2026-02-17T11:15:34.667 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.667 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.667 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.667 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6811/2172046260", 2026-02-17T11:15:34.668 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6813/2172046260", 2026-02-17T11:15:34.668 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2172046260", 2026-02-17T11:15:34.668 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2172046260", 2026-02-17T11:15:34.668 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:15:34.668 INFO:tasks.workunit.client.0.trial148.stdout: "exists" 2026-02-17T11:15:34.668 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.668 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.668 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.668 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:15:34.668 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "fc05ccb6-8c79-4405-8211-08924f11237c", 2026-02-17T11:15:34.668 INFO:tasks.workunit.client.0.trial148.stdout: "up": 1, 2026-02-17T11:15:34.668 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:15:34.668 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:15:34.669 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:15:34.669 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 13, 2026-02-17T11:15:34.669 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 29, 2026-02-17T11:15:34.669 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 38, 2026-02-17T11:15:34.669 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 0, 2026-02-17T11:15:34.669 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 32, 2026-02-17T11:15:34.669 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:15:34.669 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:15:34.669 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:15:34.669 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.669 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:15:34.669 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6810", 2026-02-17T11:15:34.670 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2900727382 2026-02-17T11:15:34.670 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.670 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.670 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:15:34.670 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6811", 2026-02-17T11:15:34.670 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2900727382 2026-02-17T11:15:34.670 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.670 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.670 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.670 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:15:34.670 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:15:34.670 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.670 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:15:34.671 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6812", 2026-02-17T11:15:34.671 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2900727382 2026-02-17T11:15:34.671 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.671 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.671 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:15:34.671 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6813", 2026-02-17T11:15:34.671 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2900727382 2026-02-17T11:15:34.671 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.671 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.671 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.671 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:15:34.671 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:15:34.672 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.672 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:15:34.672 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6816", 2026-02-17T11:15:34.672 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2900727382 2026-02-17T11:15:34.672 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.672 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.672 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:15:34.672 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6817", 2026-02-17T11:15:34.672 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2900727382 2026-02-17T11:15:34.672 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.672 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.672 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.672 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:15:34.673 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:15:34.673 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.673 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:15:34.673 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6814", 2026-02-17T11:15:34.673 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2900727382 2026-02-17T11:15:34.673 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.673 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.673 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:15:34.673 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6815", 2026-02-17T11:15:34.673 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2900727382 2026-02-17T11:15:34.673 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.673 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.673 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.673 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6811/2900727382", 2026-02-17T11:15:34.674 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6813/2900727382", 2026-02-17T11:15:34.674 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2900727382", 2026-02-17T11:15:34.674 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2900727382", 2026-02-17T11:15:34.674 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:15:34.674 INFO:tasks.workunit.client.0.trial148.stdout: "exists", 2026-02-17T11:15:34.674 INFO:tasks.workunit.client.0.trial148.stdout: "up" 2026-02-17T11:15:34.674 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.674 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.674 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:15:34.674 INFO:tasks.workunit.client.0.trial148.stdout: "osd_xinfo": [ 2026-02-17T11:15:34.675 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.675 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:15:34.675 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:14:52.182419+0000", 2026-02-17T11:15:34.675 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:15:34.675 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:15:34.675 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:15:34.675 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:15:34.675 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "2026-02-17T11:14:07.092693+0000", 2026-02-17T11:15:34.675 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:15:34.675 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.675 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.675 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:15:34.675 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:14:52.452199+0000", 2026-02-17T11:15:34.676 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:15:34.676 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:15:34.676 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:15:34.676 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:15:34.676 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "2026-02-17T11:14:15.325493+0000", 2026-02-17T11:15:34.676 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:15:34.676 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.676 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.676 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:15:34.676 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:14:52.723754+0000", 2026-02-17T11:15:34.676 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:15:34.676 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:15:34.676 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:15:34.676 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:15:34.676 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "2026-02-17T11:14:24.516330+0000", 2026-02-17T11:15:34.677 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:15:34.677 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.677 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:15:34.677 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap": [], 2026-02-17T11:15:34.677 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap_items": [], 2026-02-17T11:15:34.677 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap_primaries": [], 2026-02-17T11:15:34.677 INFO:tasks.workunit.client.0.trial148.stdout: "pg_temp": [], 2026-02-17T11:15:34.677 INFO:tasks.workunit.client.0.trial148.stdout: "primary_temp": [], 2026-02-17T11:15:34.677 INFO:tasks.workunit.client.0.trial148.stdout: "blocklist": {}, 2026-02-17T11:15:34.677 INFO:tasks.workunit.client.0.trial148.stdout: "range_blocklist": {}, 2026-02-17T11:15:34.677 INFO:tasks.workunit.client.0.trial148.stdout: "erasure_code_profiles": { 2026-02-17T11:15:34.677 INFO:tasks.workunit.client.0.trial148.stdout: "default": { 2026-02-17T11:15:34.677 INFO:tasks.workunit.client.0.trial148.stdout: "k": "2", 2026-02-17T11:15:34.677 INFO:tasks.workunit.client.0.trial148.stdout: "m": "2", 2026-02-17T11:15:34.678 INFO:tasks.workunit.client.0.trial148.stdout: "plugin": "jerasure", 2026-02-17T11:15:34.678 INFO:tasks.workunit.client.0.trial148.stdout: "technique": "reed_sol_van" 2026-02-17T11:15:34.678 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.678 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.678 INFO:tasks.workunit.client.0.trial148.stdout: "removed_snaps_queue": [], 2026-02-17T11:15:34.678 INFO:tasks.workunit.client.0.trial148.stdout: "new_removed_snaps": [], 2026-02-17T11:15:34.678 INFO:tasks.workunit.client.0.trial148.stdout: "new_purged_snaps": [], 2026-02-17T11:15:34.678 INFO:tasks.workunit.client.0.trial148.stdout: "crush_node_flags": {}, 2026-02-17T11:15:34.678 INFO:tasks.workunit.client.0.trial148.stdout: "device_class_flags": {}, 2026-02-17T11:15:34.678 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode": { 2026-02-17T11:15:34.678 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode_enabled": false, 2026-02-17T11:15:34.678 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_bucket_count": 0, 2026-02-17T11:15:34.678 INFO:tasks.workunit.client.0.trial148.stdout: "degraded_stretch_mode": 0, 2026-02-17T11:15:34.678 INFO:tasks.workunit.client.0.trial148.stdout: "recovering_stretch_mode": 0, 2026-02-17T11:15:34.678 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode_bucket": 0 2026-02-17T11:15:34.678 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.679 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.679 INFO:tasks.workunit.client.0.trial148.stdout: "osd_metadata": [ 2026-02-17T11:15:34.679 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.679 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:15:34.679 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:15:34.679 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6804/2257203782,v1:127.0.0.1:6805/2257203782]", 2026-02-17T11:15:34.679 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:15:34.679 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:15:34.679 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:15:34.679 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:15:34.679 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:15:34.679 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:15:34.679 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:15:34.679 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:15:34.679 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:15:34.680 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:15:34.680 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:15:34.680 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:15:34.680 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T11:15:34.680 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:15:34.680 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:15:34.680 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:15:34.680 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:15:34.680 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:15:34.680 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:15:34.680 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:15:34.680 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:15:34.680 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:15:34.680 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:15:34.680 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:14:00.658021Z", 2026-02-17T11:15:34.680 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:15:34.680 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:15:34.681 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:15:34.681 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:15:34.681 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:15:34.681 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:15:34.681 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:15:34.681 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6802/2257203782,v1:127.0.0.1:6803/2257203782]", 2026-02-17T11:15:34.681 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:15:34.681 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/2257203782,v1:127.0.0.1:6809/2257203782]", 2026-02-17T11:15:34.681 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/2257203782,v1:127.0.0.1:6807/2257203782]", 2026-02-17T11:15:34.681 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:15:34.681 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:15:34.681 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:15:34.681 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:15:34.681 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:15:34.681 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:15:34.681 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:15:34.682 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:15:34.682 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:15:34.682 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:15:34.682 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T11:15:34.682 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:15:34.682 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:15:34.682 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:15:34.682 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.682 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.682 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:15:34.682 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:15:34.682 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6812/2172046260,v1:127.0.0.1:6813/2172046260]", 2026-02-17T11:15:34.682 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:15:34.682 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:15:34.682 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:15:34.682 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:15:34.682 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:15:34.682 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:15:34.683 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:15:34.683 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:15:34.683 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:15:34.683 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:15:34.683 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:15:34.683 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:15:34.683 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T11:15:34.683 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:15:34.683 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:15:34.683 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:15:34.683 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:15:34.683 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:15:34.683 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:15:34.683 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:15:34.683 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:15:34.683 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:15:34.683 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:15:34.683 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:14:08.714822Z", 2026-02-17T11:15:34.683 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:15:34.684 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:15:34.684 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:15:34.684 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:15:34.684 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:15:34.684 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:15:34.684 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:15:34.684 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6810/2172046260,v1:127.0.0.1:6811/2172046260]", 2026-02-17T11:15:34.684 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:15:34.684 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2172046260,v1:127.0.0.1:6817/2172046260]", 2026-02-17T11:15:34.684 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2172046260,v1:127.0.0.1:6815/2172046260]", 2026-02-17T11:15:34.684 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:15:34.684 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:15:34.684 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:15:34.684 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:15:34.684 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:15:34.684 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:15:34.684 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:15:34.684 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:15:34.684 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:15:34.685 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:15:34.685 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T11:15:34.685 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:15:34.685 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:15:34.685 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:15:34.685 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.685 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.685 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:15:34.685 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:15:34.685 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6812/2900727382,v1:127.0.0.1:6813/2900727382]", 2026-02-17T11:15:34.685 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:15:34.685 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:15:34.685 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:15:34.685 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:15:34.685 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:15:34.685 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:15:34.685 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:15:34.685 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:15:34.686 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:15:34.686 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:15:34.686 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:15:34.686 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:15:34.686 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T11:15:34.686 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:15:34.686 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:15:34.686 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:15:34.686 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:15:34.686 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:15:34.686 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:15:34.686 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:15:34.686 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:15:34.686 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:15:34.686 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:15:34.686 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:14:17.959658Z", 2026-02-17T11:15:34.686 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:15:34.686 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:15:34.686 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6810/2900727382,v1:127.0.0.1:6811/2900727382]", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2900727382,v1:127.0.0.1:6817/2900727382]", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2900727382,v1:127.0.0.1:6815/2900727382]", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:15:34.687 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_clean_epochs": { 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: "min_last_epoch_clean": 26, 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_clean": { 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: "per_pool": [ 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: "poolid": 1, 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: "floor": 26 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: "osd_epochs": [ 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 36 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.688 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 38 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_first_committed": 1, 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_last_committed": 41, 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: "crushmap": { 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: "devices": [ 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.0", 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.1", 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.2", 2026-02-17T11:15:34.689 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: "types": [ 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 0, 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd" 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: "name": "host" 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 2, 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: "name": "chassis" 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 3, 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: "name": "rack" 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 4, 2026-02-17T11:15:34.690 INFO:tasks.workunit.client.0.trial148.stdout: "name": "row" 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 5, 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: "name": "pdu" 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 6, 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: "name": "pod" 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 7, 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: "name": "room" 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 8, 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: "name": "datacenter" 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 9, 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: "name": "zone" 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.691 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 10, 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: "name": "region" 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: "name": "root" 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: "buckets": [ 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: "id": -1, 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: "name": "default", 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "root", 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: "id": -3, 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:15:34.692 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: "id": -2, 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: "name": "default~ssd", 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "root", 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: "id": -4, 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: "id": -3, 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: "name": "trial148", 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:15:34.693 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "host", 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 1 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 2 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: "id": -4, 2026-02-17T11:15:34.694 INFO:tasks.workunit.client.0.trial148.stdout: "name": "trial148~ssd", 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "host", 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 1 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 2 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.695 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: "rules": [ 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: "rule_id": 0, 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: "rule_name": "replicated_rule", 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: "type": 1, 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: "steps": [ 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: "op": "take", 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: "item": -1, 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: "item_name": "default" 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: "op": "choose_firstn", 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: "num": 0, 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: "type": "osd" 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: "op": "emit" 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: "tunables": { 2026-02-17T11:15:34.696 INFO:tasks.workunit.client.0.trial148.stdout: "choose_local_tries": 0, 2026-02-17T11:15:34.697 INFO:tasks.workunit.client.0.trial148.stdout: "choose_local_fallback_tries": 0, 2026-02-17T11:15:34.697 INFO:tasks.workunit.client.0.trial148.stdout: "choose_total_tries": 50, 2026-02-17T11:15:34.697 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_descend_once": 1, 2026-02-17T11:15:34.697 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_vary_r": 1, 2026-02-17T11:15:34.697 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_stable": 1, 2026-02-17T11:15:34.697 INFO:tasks.workunit.client.0.trial148.stdout: "msr_descents": 100, 2026-02-17T11:15:34.697 INFO:tasks.workunit.client.0.trial148.stdout: "msr_collision_tries": 100, 2026-02-17T11:15:34.697 INFO:tasks.workunit.client.0.trial148.stdout: "straw_calc_version": 1, 2026-02-17T11:15:34.697 INFO:tasks.workunit.client.0.trial148.stdout: "allowed_bucket_algs": 54, 2026-02-17T11:15:34.697 INFO:tasks.workunit.client.0.trial148.stdout: "profile": "jewel", 2026-02-17T11:15:34.697 INFO:tasks.workunit.client.0.trial148.stdout: "optimal_tunables": 1, 2026-02-17T11:15:34.697 INFO:tasks.workunit.client.0.trial148.stdout: "legacy_tunables": 0, 2026-02-17T11:15:34.697 INFO:tasks.workunit.client.0.trial148.stdout: "minimum_required_version": "jewel", 2026-02-17T11:15:34.697 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables": 1, 2026-02-17T11:15:34.697 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables2": 1, 2026-02-17T11:15:34.697 INFO:tasks.workunit.client.0.trial148.stderr:report 1696320666 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "has_v2_rules": 0, 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables3": 1, 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "has_v3_rules": 0, 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "has_v4_buckets": 1, 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables5": 1, 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "has_v5_rules": 0, 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "has_msr_rules": 0 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "choose_args": {} 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "fsmap": { 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 1, 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "btime": "2026-02-17T11:13:58:239397+0000", 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "default_fscid": -1, 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "compat": { 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "compat": {}, 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "ro_compat": {}, 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "incompat": { 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "feature_1": "base v0.20", 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "feature_2": "client writeable ranges", 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "feature_4": "dir inode in separate object", 2026-02-17T11:15:34.698 INFO:tasks.workunit.client.0.trial148.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "feature_8": "no anchor table", 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "feature_9": "file layout v2", 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "feature_10": "snaprealm v2", 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "feature_11": "minor log segments", 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "feature_flags": { 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "enable_multiple": true, 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "ever_enabled_multiple": true 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "standbys": [], 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "filesystems": [] 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "mdsmap_first_committed": 1, 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "mdsmap_last_committed": 1, 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "auth": { 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "first_committed": 1, 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "last_committed": 5, 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "num_secrets": 3 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg": 1, 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_active": 1, 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_unknown": 0, 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "num_osd": 3, 2026-02-17T11:15:34.699 INFO:tasks.workunit.client.0.trial148.stdout: "pool_sum": { 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "stat_sum": { 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes": 69500, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects": 100, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_clones": 0, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_copies": 300, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing": 0, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_degraded": 100, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_misplaced": 0, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_unfound": 0, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_dirty": 100, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_whiteouts": 0, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_read": 0, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_read_kb": 0, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_write": 100, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_write_kb": 100, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_scrub_errors": 0, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_deep_scrub_errors": 0, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_recovered": 0, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_recovered": 0, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_keys_recovered": 0, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_omap": 0, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush": 0, 2026-02-17T11:15:34.700 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_kb": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_kb": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "num_promote": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_high": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_low": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_some": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_full": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_pinned": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "num_legacy_snapsets": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "num_large_omap_objects": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_manifest": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_bytes": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_keys": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_repaired": 0 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "store_stats": { 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "total": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "available": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 0, 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 0 2026-02-17T11:15:34.701 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "log_size": 16, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "ondisk_log_size": 16, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "up": 2, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "acting": 2, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "num_store_stats": 0 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "osd_sum": { 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 0, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 0, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "num_pgs": 3, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "num_osds": 3, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_osds": 3, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "kb": 314572800, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used": 84044, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_data": 2112, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_omap": 10, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_meta": 81845, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "kb_avail": 314488756, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "statfs": { 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "total": 322122547200, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "available": 322036486144, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 2162688, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 490249, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:15:34.702 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 10389, 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 83810155 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "hb_peers": [], 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "snap_trim_queue_len": 0, 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "num_snap_trimming": 0, 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "num_shards_repaired": 1, 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "op_queue_age_hist": { 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "histogram": [], 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "upper_bound": 1 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "perf_stat": { 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ms": 0, 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ms": 0, 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ns": 0, 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ns": 0 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "alerts": [], 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "network_ping_times": [] 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "osd_sum_by_class": { 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "ssd": { 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 0, 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 0, 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "num_pgs": 3, 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "num_osds": 3, 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_osds": 3, 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T11:15:34.703 INFO:tasks.workunit.client.0.trial148.stdout: "kb": 314572800, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used": 84044, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_data": 2112, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_omap": 10, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_meta": 81845, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "kb_avail": 314488756, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "statfs": { 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "total": 322122547200, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "available": 322036486144, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 2162688, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 490249, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 10389, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 83810155 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "hb_peers": [], 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "snap_trim_queue_len": 0, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "num_snap_trimming": 0, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "num_shards_repaired": 1, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "op_queue_age_hist": { 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "histogram": [], 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "upper_bound": 1 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "perf_stat": { 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ms": 0, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ms": 0, 2026-02-17T11:15:34.704 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ns": 0, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ns": 0 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "alerts": [], 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "network_ping_times": [] 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "pool_stats": [ 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "poolid": 1, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg": 1, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "stat_sum": { 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes": 69500, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects": 100, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_clones": 0, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_copies": 300, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing": 0, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_degraded": 100, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_misplaced": 0, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_unfound": 0, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_dirty": 100, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_whiteouts": 0, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_read": 0, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_read_kb": 0, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_write": 100, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_write_kb": 100, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_scrub_errors": 0, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_deep_scrub_errors": 0, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_recovered": 0, 2026-02-17T11:15:34.705 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_recovered": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_keys_recovered": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_omap": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_kb": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_kb": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_promote": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_high": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_low": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_some": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_full": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_pinned": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_legacy_snapsets": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_large_omap_objects": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_manifest": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_bytes": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_keys": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_repaired": 0 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "store_stats": { 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "total": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "available": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 1228800, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 208500, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:15:34.706 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 0, 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 0 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: "log_size": 16, 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: "ondisk_log_size": 16, 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: "up": 2, 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: "acting": 2, 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: "num_store_stats": 3 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: "osd_stats": [ 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 154618822665 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 38654705678 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 163208757256 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_by_state": [ 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: "state": "active+undersized+degraded", 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: "num": 1 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.707 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_by_osd": [ 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 0, 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 1, 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 1, 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 1, 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 0, 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 0, 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snaps": [ 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "pool": 1, 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snaps": {} 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "servicemap": { 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 4, 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:15:16.671713+0000", 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "services": { 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "osd": { 2026-02-17T11:15:34.708 INFO:tasks.workunit.client.0.trial148.stdout: "daemons": { 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "summary": "", 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "0": { 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "start_epoch": 0, 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "start_stamp": "0.000000", 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "gid": 0, 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "metadata": {}, 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "task_status": {} 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "2": { 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "start_epoch": 0, 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "start_stamp": "0.000000", 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "gid": 0, 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "metadata": {}, 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "task_status": {} 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "mgrstat_first_committed": 1, 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "mgrstat_last_committed": 45, 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "logm_first_committed": 1, 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "logm_last_committed": 241, 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "paxos": { 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "first_committed": 1, 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "last_committed": 338, 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "last_pn": 0, 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: "accepted_pn": 0 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:15:34.709 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:15:34.710 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1680: wait_for_clean: return 1 2026-02-17T11:15:34.710 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:153: TEST_divergent: expr 2 + 2 2026-02-17T11:15:34.710 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:153: TEST_divergent: objname=existing_4 2026-02-17T11:15:34.710 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: echo 'writing non-divergent object existing_4' 2026-02-17T11:15:34.710 INFO:tasks.workunit.client.0.trial148.stdout:writing non-divergent object existing_4 2026-02-17T11:15:34.710 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:155: TEST_divergent: ceph pg dump pgs 2026-02-17T11:15:34.839 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:15:34.839 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 100 0 0 69500 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:15:04.528385+0000 29'100 41:136 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:14:26.288530+0000 0'0 2026-02-17T11:14:26.288530+0000 0 0 periodic scrub scheduled @ 2026-02-18T15:26:03.248513+0000 0 0 2026-02-17T11:15:34.839 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:15:34.839 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:15:34.839 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:15:34.847 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:156: TEST_divergent: rados -p test put existing_4 /etc/resolv.conf 2026-02-17T11:15:34.878 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: echo 'delay recovery' 2026-02-17T11:15:34.878 INFO:tasks.workunit.client.0.trial148.stdout:delay recovery 2026-02-17T11:15:34.878 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:160: TEST_divergent: ceph pg dump pgs 2026-02-17T11:15:35.072 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:15:35.072 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 100 0 0 69500 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:15:04.528385+0000 29'100 41:136 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:14:26.288530+0000 0'0 2026-02-17T11:14:26.288530+0000 0 0 periodic scrub scheduled @ 2026-02-18T15:26:03.248513+0000 0 0 2026-02-17T11:15:35.073 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:15:35.073 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:15:35.073 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:15:35.080 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: for i in $non_divergent 2026-02-17T11:15:35.081 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:163: TEST_divergent: get_asok_path osd.0 2026-02-17T11:15:35.082 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T11:15:35.082 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T11:15:35.082 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:15:35.082 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:15:35.082 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:15:35.083 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.0.asok 2026-02-17T11:15:35.083 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:163: TEST_divergent: CEPH_ARGS= 2026-02-17T11:15:35.083 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:163: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.0.asok set_recovery_delay 100000 2026-02-17T11:15:35.136 INFO:tasks.workunit.client.0.trial148.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T11:15:35.142 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: for i in $non_divergent 2026-02-17T11:15:35.143 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:163: TEST_divergent: get_asok_path osd.2 2026-02-17T11:15:35.143 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2026-02-17T11:15:35.143 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2026-02-17T11:15:35.143 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:15:35.143 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:15:35.143 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:15:35.144 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.2.asok 2026-02-17T11:15:35.144 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:163: TEST_divergent: CEPH_ARGS= 2026-02-17T11:15:35.144 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:163: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.2.asok set_recovery_delay 100000 2026-02-17T11:15:35.195 INFO:tasks.workunit.client.0.trial148.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T11:15:35.200 INFO:tasks.workunit.client.0.trial148.stdout:revive divergent 1 2026-02-17T11:15:35.201 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:167: TEST_divergent: echo 'revive divergent 1' 2026-02-17T11:15:35.201 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:168: TEST_divergent: ceph pg dump pgs 2026-02-17T11:15:35.399 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:15:35.400 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 100 0 0 69500 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:15:04.528385+0000 29'100 41:136 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:14:26.288530+0000 0'0 2026-02-17T11:14:26.288530+0000 0 0 periodic scrub scheduled @ 2026-02-18T15:26:03.248513+0000 0 0 2026-02-17T11:15:35.400 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:15:35.400 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:15:35.400 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:15:35.408 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:169: TEST_divergent: ceph osd set noup 2026-02-17T11:15:35.716 INFO:tasks.workunit.client.0.trial148.stderr:noup is set 2026-02-17T11:15:35.727 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:170: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-17T11:15:35.727 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/divergent-priors 2026-02-17T11:15:35.727 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:15:35.728 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T11:15:35.728 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:15:35.728 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T11:15:35.728 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:15:35.728 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:15:35.728 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:15:35.728 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:15:35.728 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T11:15:35.728 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T11:15:35.728 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:15:35.728 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:15:35.729 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:15:35.729 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:15:35.729 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:15:35.729 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:15:35.729 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:15:35.729 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:15:35.729 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:15:35.729 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:15:35.729 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:15:35.729 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:15:35.729 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:15:35.729 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:15:35.730 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:15:35.730 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:15:35.730 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:15:35.730 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:15:35.730 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:15:35.730 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:15:35.730 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T11:15:35.731 INFO:tasks.workunit.client.0.trial148.stdout:start osd.1 2026-02-17T11:15:35.731 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T11:15:35.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:15:35.732 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T11:15:35.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T11:15:35.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:15:35.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:15:35.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:15:35.751 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:15:35.739+0000 7f0a03f108c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:15:35.753 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:15:35.743+0000 7f0a03f108c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:15:35.754 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:15:35.743+0000 7f0a03f108c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:15:35.938 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:880: activate_osd: return 0 2026-02-17T11:15:35.938 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:171: TEST_divergent: sleep 5 2026-02-17T11:15:36.987 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:15:36.975+0000 7f0a03f108c0 -1 Falling back to public interface 2026-02-17T11:15:39.981 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:15:39.967+0000 7f0a03f108c0 -1 osd.1 29 log_to_monitors true 2026-02-17T11:15:40.939 INFO:tasks.workunit.client.0.trial148.stdout:delay recovery divergent 2026-02-17T11:15:40.940 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: echo 'delay recovery divergent' 2026-02-17T11:15:40.940 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:174: TEST_divergent: ceph pg dump pgs 2026-02-17T11:15:41.125 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:15:41.126 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 100 0 0 69772 0 0 17 84 17 active+undersized+degraded 2026-02-17T11:15:04.528385+0000 41'101 43:141 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:14:26.288530+0000 0'0 2026-02-17T11:14:26.288530+0000 0 0 periodic scrub scheduled @ 2026-02-18T15:26:03.248513+0000 0 0 2026-02-17T11:15:41.126 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:15:41.126 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:15:41.126 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:15:41.134 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:175: TEST_divergent: get_asok_path osd.1 2026-02-17T11:15:41.134 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T11:15:41.134 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T11:15:41.135 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:15:41.135 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:15:41.135 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:15:41.135 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.1.asok 2026-02-17T11:15:41.135 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:175: TEST_divergent: CEPH_ARGS= 2026-02-17T11:15:41.135 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:175: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.1.asok set_recovery_delay 100000 2026-02-17T11:15:41.188 INFO:tasks.workunit.client.0.trial148.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T11:15:41.193 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:177: TEST_divergent: ceph osd unset noup 2026-02-17T11:15:41.506 INFO:tasks.workunit.client.0.trial148.stderr:noup is unset 2026-02-17T11:15:41.517 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:179: TEST_divergent: wait_for_osd up 0 2026-02-17T11:15:41.517 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:15:41.517 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T11:15:41.517 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:15:41.517 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:15:41.517 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:15:41.518 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:15:41.518 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:15:41.518 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:15:41.518 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:15:41.721 INFO:tasks.workunit.client.0.trial148.stdout:osd.0 up in weight 1 up_from 36 up_thru 40 down_at 30 last_clean_interval [5,29) [v2:127.0.0.1:6802/2257203782,v1:127.0.0.1:6803/2257203782] [v2:127.0.0.1:6804/2257203782,v1:127.0.0.1:6805/2257203782] exists,up 951a1d3e-5227-4925-8600-0a5d6411bee8 2026-02-17T11:15:41.722 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:15:41.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:15:41.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:15:41.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:180: TEST_divergent: wait_for_osd up 1 2026-02-17T11:15:41.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:15:41.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T11:15:41.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:15:41.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:15:41.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:15:41.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:15:41.724 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:15:41.724 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:15:41.724 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:15:41.922 INFO:tasks.workunit.client.0.trial148.stdout:osd.1 up in weight 1 up_from 46 up_thru 46 down_at 31 last_clean_interval [9,29) [v2:127.0.0.1:6818/1425801670,v1:127.0.0.1:6819/1425801670] [v2:127.0.0.1:6820/1425801670,v1:127.0.0.1:6821/1425801670] exists,up 793cab14-e8f0-48e0-b312-0d146e33192d 2026-02-17T11:15:41.924 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:15:41.924 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:15:41.924 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:15:41.924 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:181: TEST_divergent: wait_for_osd up 2 2026-02-17T11:15:41.924 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:15:41.924 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T11:15:41.924 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:15:41.924 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:15:41.924 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:15:41.924 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:15:41.925 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:15:41.925 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:15:41.925 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:15:42.121 INFO:tasks.workunit.client.0.trial148.stdout:osd.2 up in weight 1 up_from 38 up_thru 0 down_at 32 last_clean_interval [13,29) [v2:127.0.0.1:6810/2900727382,v1:127.0.0.1:6811/2900727382] [v2:127.0.0.1:6812/2900727382,v1:127.0.0.1:6813/2900727382] exists,up fc05ccb6-8c79-4405-8211-08924f11237c 2026-02-17T11:15:42.122 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:15:42.122 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:15:42.122 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:15:42.122 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:183: TEST_divergent: ceph pg dump pgs 2026-02-17T11:15:42.310 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:15:42.310 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 100 0 0 69772 0 0 17 84 17 active+undersized+degraded 2026-02-17T11:15:04.528385+0000 41'101 43:141 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:14:26.288530+0000 0'0 2026-02-17T11:14:26.288530+0000 0 0 periodic scrub scheduled @ 2026-02-18T15:26:03.248513+0000 0 0 2026-02-17T11:15:42.311 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:15:42.311 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:15:42.311 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:15:42.318 INFO:tasks.workunit.client.0.trial148.stdout:wait for peering 2026-02-17T11:15:42.319 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:184: TEST_divergent: echo 'wait for peering' 2026-02-17T11:15:42.319 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:185: TEST_divergent: ceph pg dump pgs 2026-02-17T11:15:42.505 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:15:42.505 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 100 0 0 69772 0 0 17 84 17 active+undersized+degraded 2026-02-17T11:15:04.528385+0000 41'101 43:141 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:14:26.288530+0000 0'0 2026-02-17T11:14:26.288530+0000 0 0 periodic scrub scheduled @ 2026-02-18T15:26:03.248513+0000 0 0 2026-02-17T11:15:42.505 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:15:42.506 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:15:42.506 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:15:42.513 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:186: TEST_divergent: rados -p test put foo /etc/fstab 2026-02-17T11:15:42.535 INFO:tasks.workunit.client.0.trial148.stdout:killing divergent 1 2026-02-17T11:15:42.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:188: TEST_divergent: echo 'killing divergent 1' 2026-02-17T11:15:42.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:189: TEST_divergent: ceph pg dump pgs 2026-02-17T11:15:42.729 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:15:42.730 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 100 0 0 69772 0 0 17 84 17 active+undersized+degraded 2026-02-17T11:15:04.528385+0000 41'101 43:141 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:14:26.288530+0000 0'0 2026-02-17T11:14:26.288530+0000 0 0 periodic scrub scheduled @ 2026-02-18T15:26:03.248513+0000 0 0 2026-02-17T11:15:42.730 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:15:42.730 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:15:42.730 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:15:42.739 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:190: TEST_divergent: kill_daemons td/divergent-priors KILL osd.1 2026-02-17T11:15:42.739 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:15:42.740 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:15:42.740 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:15:42.740 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:15:42.740 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:15:42.846 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:15:42.847 INFO:tasks.workunit.client.0.trial148.stdout:reviving divergent 1 2026-02-17T11:15:42.848 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:192: TEST_divergent: echo 'reviving divergent 1' 2026-02-17T11:15:42.848 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:193: TEST_divergent: ceph pg dump pgs 2026-02-17T11:15:43.038 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:15:43.038 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 100 0 0 69772 0 0 17 84 17 active+undersized+degraded 2026-02-17T11:15:04.528385+0000 41'101 43:141 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:14:26.288530+0000 0'0 2026-02-17T11:14:26.288530+0000 0 0 periodic scrub scheduled @ 2026-02-18T15:26:03.248513+0000 0 0 2026-02-17T11:15:43.038 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:15:43.038 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:15:43.039 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:15:43.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:194: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-17T11:15:43.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/divergent-priors 2026-02-17T11:15:43.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:15:43.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T11:15:43.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:15:43.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T11:15:43.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:15:43.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:15:43.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:15:43.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:15:43.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T11:15:43.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T11:15:43.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:15:43.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:15:43.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:15:43.052 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:15:43.052 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:15:43.052 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:15:43.052 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:15:43.052 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:15:43.052 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:15:43.053 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:15:43.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:15:43.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:15:43.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:15:43.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:15:43.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:15:43.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:15:43.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:15:43.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:15:43.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:15:43.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:15:43.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T11:15:43.054 INFO:tasks.workunit.client.0.trial148.stdout:start osd.1 2026-02-17T11:15:43.055 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T11:15:43.055 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:15:43.055 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T11:15:43.055 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T11:15:43.055 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:15:43.055 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:15:43.056 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:15:43.071 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:15:43.059+0000 7fdeea7d58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:15:43.073 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:15:43.059+0000 7fdeea7d58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:15:43.074 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:15:43.063+0000 7fdeea7d58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:15:43.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2026-02-17T11:15:43.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:15:43.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T11:15:43.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:15:43.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:15:43.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:15:43.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:15:43.252 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:15:43.252 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:15:43.252 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:15:43.456 INFO:tasks.workunit.client.0.trial148.stdout:osd.1 up in weight 1 up_from 46 up_thru 46 down_at 31 last_clean_interval [9,29) [v2:127.0.0.1:6818/1425801670,v1:127.0.0.1:6819/1425801670] [v2:127.0.0.1:6820/1425801670,v1:127.0.0.1:6821/1425801670] exists,up 793cab14-e8f0-48e0-b312-0d146e33192d 2026-02-17T11:15:43.457 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:15:43.457 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:15:43.457 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:15:43.457 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:196: TEST_divergent: sleep 20 2026-02-17T11:15:44.787 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:15:44.775+0000 7fdeea7d58c0 -1 Falling back to public interface 2026-02-17T11:15:47.788 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:15:47.775+0000 7fdeea7d58c0 -1 osd.1 47 log_to_monitors true 2026-02-17T11:16:03.455 INFO:tasks.workunit.client.0.trial148.stdout:allowing recovery 2026-02-17T11:16:03.456 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:198: TEST_divergent: echo 'allowing recovery' 2026-02-17T11:16:03.456 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: ceph pg dump pgs 2026-02-17T11:16:03.647 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:16:03.647 INFO:tasks.workunit.client.0.trial148.stdout:1.0 101 0 0 0 0 70467 0 0 18 84 18 active+clean 2026-02-17T11:15:48.934492+0000 47'102 51:165 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:14:26.288530+0000 0'0 2026-02-17T11:14:26.288530+0000 0 0 periodic scrub scheduled @ 2026-02-18T14:24:41.442914+0000 0 0 2026-02-17T11:16:03.647 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:16:03.647 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:16:03.648 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:16:03.655 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: for i in $osds 2026-02-17T11:16:03.655 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:203: TEST_divergent: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-17T11:16:03.740 INFO:tasks.workunit.client.0.trial148.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T11:16:03.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: for i in $osds 2026-02-17T11:16:03.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:203: TEST_divergent: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-17T11:16:03.826 INFO:tasks.workunit.client.0.trial148.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T11:16:03.833 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: for i in $osds 2026-02-17T11:16:03.833 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:203: TEST_divergent: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-17T11:16:03.913 INFO:tasks.workunit.client.0.trial148.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T11:16:03.920 INFO:tasks.workunit.client.0.trial148.stdout:reading divergent objects 2026-02-17T11:16:03.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: echo 'reading divergent objects' 2026-02-17T11:16:03.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:207: TEST_divergent: ceph pg dump pgs 2026-02-17T11:16:04.121 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:16:04.121 INFO:tasks.workunit.client.0.trial148.stdout:1.0 101 0 0 0 0 70467 0 0 18 84 18 active+clean 2026-02-17T11:15:48.934492+0000 47'102 51:165 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:14:26.288530+0000 0'0 2026-02-17T11:14:26.288530+0000 0 0 periodic scrub scheduled @ 2026-02-18T14:24:41.442914+0000 0 0 2026-02-17T11:16:04.121 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:16:04.121 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:16:04.122 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:16:04.130 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: expr 2 + 2 2026-02-17T11:16:04.131 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: seq 1 4 2026-02-17T11:16:04.132 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T11:16:04.132 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:210: TEST_divergent: rados -p test get existing_1 td/divergent-priors/existing 2026-02-17T11:16:04.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T11:16:04.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:210: TEST_divergent: rados -p test get existing_2 td/divergent-priors/existing 2026-02-17T11:16:04.183 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T11:16:04.183 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:210: TEST_divergent: rados -p test get existing_3 td/divergent-priors/existing 2026-02-17T11:16:04.208 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T11:16:04.209 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:210: TEST_divergent: rados -p test get existing_4 td/divergent-priors/existing 2026-02-17T11:16:04.235 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: rm -f td/divergent-priors/existing 2026-02-17T11:16:04.236 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-17T11:16:04.237 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T11:16:04.241 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:15:41.871+0000 7f09e1e8e640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 29'101 (29'100) modify 1:c156033e:::existing_100:head by client.4552.0:1 2026-02-17T11:14:41.302661+0000 0 ObjectCleanRegions clean_offsets: [(695, 18446744073709550920)], clean_omap: true, new_object: false 2026-02-17T11:16:04.241 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:15:41.871+0000 7f09e1e8e640 20 _merge_object_divergent_entries: keeping 29'101 (29'100) modify 1:c156033e:::existing_100:head by client.4552.0:1 2026-02-17T11:14:41.302661+0000 0 ObjectCleanRegions clean_offsets: [(695, 18446744073709550920)], clean_omap: true, new_object: false 2026-02-17T11:16:04.241 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:15:41.871+0000 7f09e1e8e640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T11:16:04.242 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:15:41.871+0000 7f09e1e8e640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 29'100 first_divergent_update: 29'101 last_divergent_update: 29'101 2026-02-17T11:16:04.242 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:15:41.871+0000 7f09e1e8e640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-17T11:16:04.242 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:15:41.871+0000 7f09e1e8e640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-17T11:16:04.242 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:15:41.871+0000 7f09e1e8e640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 29'101 2026-02-17T11:16:04.242 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:15:41.871+0000 7f09e1e8e640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 29'101 (29'100) modify 1:c156033e:::existing_100:head by client.4552.0:1 2026-02-17T11:14:41.302661+0000 0 ObjectCleanRegions clean_offsets: [(695, 18446744073709550920)], clean_omap: true, new_object: false 2026-02-17T11:16:04.242 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:15:41.871+0000 7f09e1e8e640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-17T11:16:04.243 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:216: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-17T11:16:04.243 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:216: TEST_divergent: grep -q '_merge_object_divergent_entries.*cannot roll back, removing and adding to missing' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T11:16:04.246 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:221: TEST_divergent: echo success 2026-02-17T11:16:04.246 INFO:tasks.workunit.client.0.trial148.stdout:success 2026-02-17T11:16:04.247 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:223: TEST_divergent: delete_pool test 2026-02-17T11:16:04.247 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test 2026-02-17T11:16:04.247 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-17T11:16:04.499 INFO:tasks.workunit.client.0.trial148.stderr:pool 'test' does not exist 2026-02-17T11:16:04.508 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:224: TEST_divergent: kill_daemons td/divergent-priors 2026-02-17T11:16:04.509 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:16:04.509 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:16:04.509 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:16:04.509 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:16:04.510 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:16:12.825 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:16:12.825 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-17T11:16:12.825 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/divergent-priors 2026-02-17T11:16:12.825 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T11:16:12.825 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T11:16:12.825 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:16:12.825 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:16:12.826 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:16:12.826 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:16:12.826 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:16:12.832 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:16:12.833 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:16:12.834 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:16:12.834 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:16:12.835 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:16:12.836 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:16:12.836 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:16:12.837 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:16:12.837 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:16:12.837 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:16:12.838 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:16:12.839 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:16:12.840 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T11:16:12.840 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/divergent-priors 2026-02-17T11:16:12.856 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:16:12.856 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:16:12.856 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:16:12.856 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.19803 2026-02-17T11:16:12.858 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T11:16:12.858 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T11:16:12.858 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-17T11:16:12.858 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-17T11:16:12.858 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/divergent-priors 2026-02-17T11:16:12.858 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/divergent-priors 2026-02-17T11:16:12.858 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/divergent-priors 2026-02-17T11:16:12.858 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T11:16:12.858 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T11:16:12.858 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:16:12.858 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:16:12.858 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:16:12.858 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:16:12.858 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:16:12.861 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:16:12.861 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:16:12.862 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:16:12.862 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:16:12.863 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:16:12.863 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:16:12.863 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:16:12.864 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:16:12.864 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:16:12.865 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:16:12.865 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:16:12.866 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:16:12.867 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T11:16:12.867 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/divergent-priors 2026-02-17T11:16:12.868 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:16:12.868 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:16:12.868 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:16:12.868 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.19803 2026-02-17T11:16:12.869 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T11:16:12.869 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T11:16:12.869 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/divergent-priors 2026-02-17T11:16:12.871 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T11:16:12.871 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:16:12.871 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:16:12.871 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.19803 2026-02-17T11:16:12.873 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T11:16:12.873 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T11:16:12.873 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T11:16:12.873 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-17T11:16:12.873 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_2 td/divergent-priors 2026-02-17T11:16:12.874 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:421: TEST_divergent_2: local dir=td/divergent-priors 2026-02-17T11:16:12.874 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: local dummyfile=/etc/fstab 2026-02-17T11:16:12.874 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:425: TEST_divergent_2: local dummyfile2=/etc/resolv.conf 2026-02-17T11:16:12.874 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:427: TEST_divergent_2: local num_osds=3 2026-02-17T11:16:12.874 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:428: TEST_divergent_2: expr 3 - 1 2026-02-17T11:16:12.875 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:428: TEST_divergent_2: seq 0 2 2026-02-17T11:16:12.876 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:428: TEST_divergent_2: local 'osds=0 2026-02-17T11:16:12.876 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:16:12.876 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:16:12.876 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: run_mon td/divergent-priors a 2026-02-17T11:16:12.876 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/divergent-priors 2026-02-17T11:16:12.876 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T11:16:12.876 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T11:16:12.876 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T11:16:12.876 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/divergent-priors/a 2026-02-17T11:16:12.877 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-17T11:16:12.907 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T11:16:12.907 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:16:12.907 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:16:12.907 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:16:12.907 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:16:12.907 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:16:12.908 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:16:12.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T11:16:12.941 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T11:16:12.942 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T11:16:12.942 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T11:16:12.942 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T11:16:12.942 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T11:16:12.943 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T11:16:12.943 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T11:16:12.943 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T11:16:12.944 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T11:16:12.944 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:16:12.944 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:16:12.944 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:16:12.944 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-mon.a.asok 2026-02-17T11:16:12.944 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T11:16:12.944 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.19803/ceph-mon.a.asok config get fsid 2026-02-17T11:16:12.999 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T11:16:12.999 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T11:16:12.999 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T11:16:12.999 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T11:16:12.999 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T11:16:12.999 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T11:16:12.999 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T11:16:12.999 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T11:16:13.000 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:16:13.001 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:16:13.001 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:16:13.001 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-mon.a.asok 2026-02-17T11:16:13.001 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T11:16:13.001 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.19803/ceph-mon.a.asok config get mon_host 2026-02-17T11:16:13.054 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:430: TEST_divergent_2: run_mgr td/divergent-priors x 2026-02-17T11:16:13.054 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/divergent-priors 2026-02-17T11:16:13.054 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T11:16:13.054 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T11:16:13.054 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T11:16:13.054 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/divergent-priors/x 2026-02-17T11:16:13.054 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T11:16:13.161 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T11:16:13.162 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:16:13.162 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:16:13.162 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:16:13.162 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:16:13.162 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:16:13.162 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:16:13.163 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T11:16:13.164 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T11:16:13.187 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:431: TEST_divergent_2: for i in $osds 2026-02-17T11:16:13.187 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:433: TEST_divergent_2: run_osd td/divergent-priors 0 2026-02-17T11:16:13.187 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/divergent-priors 2026-02-17T11:16:13.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:16:13.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T11:16:13.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:16:13.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/divergent-priors/0 2026-02-17T11:16:13.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:16:13.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:16:13.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:16:13.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:16:13.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T11:16:13.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T11:16:13.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:16:13.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:16:13.189 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:16:13.189 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:16:13.189 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:16:13.189 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:16:13.189 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:16:13.189 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:16:13.189 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:16:13.189 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:16:13.189 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:16:13.189 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:16:13.189 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:16:13.189 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:16:13.189 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:16:13.189 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:16:13.189 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:16:13.190 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:16:13.190 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:16:13.190 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:16:13.190 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:16:13.190 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:16:13.190 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/divergent-priors/0 2026-02-17T11:16:13.191 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:16:13.191 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=c8aaf815-94b1-4949-96b2-b16a33de34d1 2026-02-17T11:16:13.191 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 c8aaf815-94b1-4949-96b2-b16a33de34d1' 2026-02-17T11:16:13.191 INFO:tasks.workunit.client.0.trial148.stdout:add osd0 c8aaf815-94b1-4949-96b2-b16a33de34d1 2026-02-17T11:16:13.191 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:16:13.202 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQD9TZRpE7jKCxAAw0tMfCGvraj4Vknzbti/5Q== 2026-02-17T11:16:13.202 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQD9TZRpE7jKCxAAw0tMfCGvraj4Vknzbti/5Q=="}' 2026-02-17T11:16:13.202 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new c8aaf815-94b1-4949-96b2-b16a33de34d1 -i td/divergent-priors/0/new.json 2026-02-17T11:16:13.316 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:16:13.325 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/divergent-priors/0/new.json 2026-02-17T11:16:13.326 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQD9TZRpE7jKCxAAw0tMfCGvraj4Vknzbti/5Q== --osd-uuid c8aaf815-94b1-4949-96b2-b16a33de34d1 2026-02-17T11:16:13.345 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:13.335+0000 7f635b3888c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:16:13.346 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:13.339+0000 7f635b3888c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:16:13.347 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:13.339+0000 7f635b3888c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:16:13.348 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:13.339+0000 7f635b3888c0 -1 bdev(0x559cebd59c00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-17T11:16:13.348 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:13.339+0000 7f635b3888c0 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-17T11:16:16.217 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-17T11:16:16.218 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:16:16.219 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T11:16:16.219 INFO:tasks.workunit.client.0.trial148.stdout:adding osd0 key to auth repository 2026-02-17T11:16:16.219 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:16:16.493 INFO:tasks.workunit.client.0.trial148.stdout:start osd.0 2026-02-17T11:16:16.494 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T11:16:16.494 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:16:16.494 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:16:16.494 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:16:16.495 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:16:16.521 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:16.511+0000 7fc6745da8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:16:16.522 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:16.515+0000 7fc6745da8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:16:16.524 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:16.515+0000 7fc6745da8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:16:16.701 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T11:16:16.701 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:16:16.701 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T11:16:16.701 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:16:16.701 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:16:16.701 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:16:16.701 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:16:16.702 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:16:16.702 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:16:16.702 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:16:16.907 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:16:17.909 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:16:17.910 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:16:17.910 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:16:17.911 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:16:17.911 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:16:17.911 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:16:18.112 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:16:18.243 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:18.235+0000 7fc6745da8c0 -1 Falling back to public interface 2026-02-17T11:16:19.113 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:16:19.113 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:16:19.114 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:16:19.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:16:19.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:16:19.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:16:19.313 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:16:20.315 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:16:20.315 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:16:20.315 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:16:20.316 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:16:20.316 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:16:20.316 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:16:20.517 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:16:21.253 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:21.243+0000 7fc6745da8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T11:16:21.519 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:16:21.519 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:16:21.519 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:16:21.520 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:16:21.520 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:16:21.520 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:16:21.719 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:16:22.720 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:16:22.720 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:16:22.720 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T11:16:22.721 INFO:tasks.workunit.client.0.trial148.stdout:5 2026-02-17T11:16:22.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:16:22.722 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:16:22.916 INFO:tasks.workunit.client.0.trial148.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3135354100,v1:127.0.0.1:6803/3135354100] [v2:127.0.0.1:6804/3135354100,v1:127.0.0.1:6805/3135354100] exists,up c8aaf815-94b1-4949-96b2-b16a33de34d1 2026-02-17T11:16:22.919 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:16:22.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:16:22.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:16:22.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:431: TEST_divergent_2: for i in $osds 2026-02-17T11:16:22.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:433: TEST_divergent_2: run_osd td/divergent-priors 1 2026-02-17T11:16:22.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/divergent-priors 2026-02-17T11:16:22.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:16:22.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T11:16:22.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:16:22.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/divergent-priors/1 2026-02-17T11:16:22.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:16:22.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:16:22.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:16:22.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:16:22.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T11:16:22.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T11:16:22.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:16:22.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:16:22.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:16:22.921 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:16:22.921 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:16:22.921 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:16:22.922 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:16:22.922 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:16:22.922 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:16:22.922 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:16:22.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:16:22.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:16:22.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:16:22.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:16:22.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:16:22.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:16:22.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:16:22.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:16:22.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:16:22.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:16:22.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:16:22.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:16:22.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/divergent-priors/1 2026-02-17T11:16:22.923 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:16:22.924 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=ed659628-1e35-4975-9a8a-0acf011e4716 2026-02-17T11:16:22.924 INFO:tasks.workunit.client.0.trial148.stdout:add osd1 ed659628-1e35-4975-9a8a-0acf011e4716 2026-02-17T11:16:22.925 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 ed659628-1e35-4975-9a8a-0acf011e4716' 2026-02-17T11:16:22.925 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:16:22.935 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAGTpRpZgSANxAA+cw0SuLjEU4HFc1M7kCYYw== 2026-02-17T11:16:22.936 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAGTpRpZgSANxAA+cw0SuLjEU4HFc1M7kCYYw=="}' 2026-02-17T11:16:22.936 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new ed659628-1e35-4975-9a8a-0acf011e4716 -i td/divergent-priors/1/new.json 2026-02-17T11:16:23.140 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:16:23.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/divergent-priors/1/new.json 2026-02-17T11:16:23.149 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAGTpRpZgSANxAA+cw0SuLjEU4HFc1M7kCYYw== --osd-uuid ed659628-1e35-4975-9a8a-0acf011e4716 2026-02-17T11:16:23.168 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:23.159+0000 7faa2d43e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:16:23.169 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:23.163+0000 7faa2d43e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:16:23.171 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:23.163+0000 7faa2d43e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:16:23.171 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:23.163+0000 7faa2d43e8c0 -1 bdev(0x562cd69f5c00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-17T11:16:23.171 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:23.163+0000 7faa2d43e8c0 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-17T11:16:25.442 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-17T11:16:25.442 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:16:25.443 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T11:16:25.443 INFO:tasks.workunit.client.0.trial148.stdout:adding osd1 key to auth repository 2026-02-17T11:16:25.443 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:16:25.712 INFO:tasks.workunit.client.0.trial148.stdout:start osd.1 2026-02-17T11:16:25.713 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T11:16:25.713 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:16:25.714 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:16:25.714 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:16:25.714 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:16:25.741 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:25.735+0000 7f0bb07dc8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:16:25.742 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:25.735+0000 7f0bb07dc8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:16:25.744 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:25.735+0000 7f0bb07dc8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:16:25.916 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T11:16:25.916 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:16:25.916 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T11:16:25.916 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:16:25.916 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:16:25.916 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:16:25.916 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:16:25.917 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:16:25.917 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:16:25.917 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:16:26.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:16:27.116 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:16:27.116 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:16:27.116 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:16:27.117 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:16:27.117 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:16:27.117 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:16:27.254 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:27.248+0000 7f0bb07dc8c0 -1 Falling back to public interface 2026-02-17T11:16:27.315 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:16:28.317 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:16:28.317 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:16:28.317 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:16:28.318 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:16:28.318 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:16:28.318 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:16:28.516 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:16:29.517 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:16:29.517 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:16:29.517 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:16:29.518 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:16:29.518 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:16:29.518 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:16:29.715 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:16:30.469 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:30.464+0000 7f0bb07dc8c0 -1 osd.1 0 log_to_monitors true 2026-02-17T11:16:30.716 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:16:30.716 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:16:30.717 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:16:30.717 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:16:30.717 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:16:30.718 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:16:30.914 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:16:31.915 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:16:31.916 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:16:31.916 INFO:tasks.workunit.client.0.trial148.stdout:5 2026-02-17T11:16:31.917 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T11:16:31.917 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:16:31.917 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:16:32.110 INFO:tasks.workunit.client.0.trial148.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3055380953,v1:127.0.0.1:6811/3055380953] [v2:127.0.0.1:6812/3055380953,v1:127.0.0.1:6813/3055380953] exists,up ed659628-1e35-4975-9a8a-0acf011e4716 2026-02-17T11:16:32.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:16:32.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:16:32.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:16:32.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:431: TEST_divergent_2: for i in $osds 2026-02-17T11:16:32.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:433: TEST_divergent_2: run_osd td/divergent-priors 2 2026-02-17T11:16:32.115 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/divergent-priors 2026-02-17T11:16:32.115 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:16:32.115 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T11:16:32.115 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:16:32.115 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/divergent-priors/2 2026-02-17T11:16:32.115 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:16:32.115 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:16:32.115 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:16:32.115 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:16:32.115 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T11:16:32.115 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T11:16:32.116 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:16:32.116 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:16:32.116 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:16:32.116 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:16:32.116 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:16:32.116 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:16:32.116 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:16:32.116 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:16:32.116 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:16:32.116 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:16:32.116 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:16:32.116 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:16:32.117 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:16:32.117 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:16:32.117 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:16:32.117 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:16:32.117 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:16:32.117 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:16:32.117 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:16:32.117 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:16:32.117 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:16:32.118 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:16:32.118 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/divergent-priors/2 2026-02-17T11:16:32.118 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:16:32.119 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=444f54f7-411d-409e-9057-71f2cbbc5258 2026-02-17T11:16:32.119 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 444f54f7-411d-409e-9057-71f2cbbc5258' 2026-02-17T11:16:32.119 INFO:tasks.workunit.client.0.trial148.stdout:add osd2 444f54f7-411d-409e-9057-71f2cbbc5258 2026-02-17T11:16:32.119 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:16:32.129 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAQTpRpmUqHBxAAQZ7eupQD6L0RfW9r/499hQ== 2026-02-17T11:16:32.129 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAQTpRpmUqHBxAAQZ7eupQD6L0RfW9r/499hQ=="}' 2026-02-17T11:16:32.129 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 444f54f7-411d-409e-9057-71f2cbbc5258 -i td/divergent-priors/2/new.json 2026-02-17T11:16:32.332 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:16:32.340 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/divergent-priors/2/new.json 2026-02-17T11:16:32.341 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAQTpRpmUqHBxAAQZ7eupQD6L0RfW9r/499hQ== --osd-uuid 444f54f7-411d-409e-9057-71f2cbbc5258 2026-02-17T11:16:32.360 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:32.352+0000 7f0847dc58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:16:32.361 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:32.356+0000 7f0847dc58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:16:32.362 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:32.356+0000 7f0847dc58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:16:32.362 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:32.356+0000 7f0847dc58c0 -1 bdev(0x55e64534bc00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-17T11:16:32.363 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:32.356+0000 7f0847dc58c0 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-17T11:16:34.625 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-17T11:16:34.625 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:16:34.626 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T11:16:34.626 INFO:tasks.workunit.client.0.trial148.stdout:adding osd2 key to auth repository 2026-02-17T11:16:34.627 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:16:34.899 INFO:tasks.workunit.client.0.trial148.stdout:start osd.2 2026-02-17T11:16:34.899 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T11:16:34.899 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:16:34.899 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:16:34.900 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:16:34.900 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:16:34.926 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:34.920+0000 7f05ca7248c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:16:34.928 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:34.924+0000 7f05ca7248c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:16:34.929 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:34.924+0000 7f05ca7248c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:16:35.106 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T11:16:35.106 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:16:35.106 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T11:16:35.106 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:16:35.107 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:16:35.107 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:16:35.107 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:16:35.107 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:16:35.107 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:16:35.108 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:16:35.309 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:16:36.311 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:16:36.311 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:16:36.311 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:16:36.312 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:16:36.312 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:16:36.312 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:16:36.511 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:16:36.670 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:36.664+0000 7f05ca7248c0 -1 Falling back to public interface 2026-02-17T11:16:37.513 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:16:37.513 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:16:37.513 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:16:37.514 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:16:37.514 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:16:37.514 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:16:37.719 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:16:38.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:16:38.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:16:38.721 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:16:38.722 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:16:38.722 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:16:38.722 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:16:38.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:16:39.663 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:16:39.656+0000 7f05ca7248c0 -1 osd.2 0 log_to_monitors true 2026-02-17T11:16:39.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:16:39.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:16:39.922 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:16:39.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:16:39.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:16:39.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:16:40.128 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:16:41.130 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:16:41.130 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:16:41.130 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T11:16:41.130 INFO:tasks.workunit.client.0.trial148.stdout:5 2026-02-17T11:16:41.131 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:16:41.131 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:16:41.340 INFO:tasks.workunit.client.0.trial148.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3561516529,v1:127.0.0.1:6819/3561516529] [v2:127.0.0.1:6820/3561516529,v1:127.0.0.1:6821/3561516529] exists,up 444f54f7-411d-409e-9057-71f2cbbc5258 2026-02-17T11:16:41.341 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:16:41.341 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:16:41.341 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:16:41.341 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:436: TEST_divergent_2: ceph osd set noout 2026-02-17T11:16:41.634 INFO:tasks.workunit.client.0.trial148.stderr:noout is set 2026-02-17T11:16:41.644 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:437: TEST_divergent_2: ceph osd set noin 2026-02-17T11:16:41.939 INFO:tasks.workunit.client.0.trial148.stderr:noin is set 2026-02-17T11:16:41.949 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:438: TEST_divergent_2: ceph osd set nodown 2026-02-17T11:16:42.242 INFO:tasks.workunit.client.0.trial148.stderr:nodown is set 2026-02-17T11:16:42.253 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:439: TEST_divergent_2: create_pool test 1 1 2026-02-17T11:16:42.253 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 2026-02-17T11:16:42.493 INFO:tasks.workunit.client.0.trial148.stderr:pool 'test' already exists 2026-02-17T11:16:42.502 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T11:16:43.503 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:440: TEST_divergent_2: ceph osd pool set test size 3 2026-02-17T11:16:43.805 INFO:tasks.workunit.client.0.trial148.stderr:set pool 1 size to 3 2026-02-17T11:16:43.816 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:441: TEST_divergent_2: ceph osd pool set test min_size 2 2026-02-17T11:16:44.108 INFO:tasks.workunit.client.0.trial148.stderr:set pool 1 min_size to 2 2026-02-17T11:16:44.120 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:443: TEST_divergent_2: flush_pg_stats 2026-02-17T11:16:44.120 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:16:44.120 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:16:44.322 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:16:44.322 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:16:44.322 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:16:44.322 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:16:44.322 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:16:44.322 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:16:44.403 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836487 2026-02-17T11:16:44.403 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836487 2026-02-17T11:16:44.403 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T11:16:44.403 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:16:44.403 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:16:44.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705669 2026-02-17T11:16:44.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705669 2026-02-17T11:16:44.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487 1-38654705669' 2026-02-17T11:16:44.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:16:44.482 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:16:44.564 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=60129542147 2026-02-17T11:16:44.564 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 60129542147 2026-02-17T11:16:44.565 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487 1-38654705669 2-60129542147' 2026-02-17T11:16:44.565 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:16:44.565 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836487 2026-02-17T11:16:44.566 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:16:44.566 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:16:44.567 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836487 2026-02-17T11:16:44.567 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:16:44.568 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836487 2026-02-17T11:16:44.568 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T11:16:44.568 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 21474836487 2026-02-17T11:16:44.569 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:16:44.773 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-17T11:16:44.774 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:16:45.774 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:16:45.775 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:16:45.976 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T11:16:45.976 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:16:45.976 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705669 2026-02-17T11:16:45.976 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:16:45.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T11:16:45.978 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705669 2026-02-17T11:16:45.979 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:16:45.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705669 2026-02-17T11:16:45.980 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.1 seq 38654705669 2026-02-17T11:16:45.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705669' 2026-02-17T11:16:45.980 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T11:16:46.187 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705669 -lt 38654705669 2026-02-17T11:16:46.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:16:46.188 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-60129542147 2026-02-17T11:16:46.188 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:16:46.190 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:16:46.191 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-60129542147 2026-02-17T11:16:46.191 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:16:46.192 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=60129542147 2026-02-17T11:16:46.192 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 60129542147 2026-02-17T11:16:46.193 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T11:16:46.193 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:16:46.393 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 60129542147 -lt 60129542147 2026-02-17T11:16:46.393 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:444: TEST_divergent_2: wait_for_clean 2026-02-17T11:16:46.393 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T11:16:46.393 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T11:16:46.393 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T11:16:46.394 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T11:16:46.394 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T11:16:46.395 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T11:16:46.395 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T11:16:46.395 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T11:16:46.395 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T11:16:46.493 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T11:16:46.493 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T11:16:46.493 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T11:16:46.494 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T11:16:46.494 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:16:46.494 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:16:46.690 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:16:46.690 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:16:46.690 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:16:46.690 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:16:46.690 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:16:46.690 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:16:46.771 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836489 2026-02-17T11:16:46.771 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836489 2026-02-17T11:16:46.771 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836489' 2026-02-17T11:16:46.771 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:16:46.771 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:16:46.850 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705672 2026-02-17T11:16:46.850 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705672 2026-02-17T11:16:46.850 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836489 1-38654705672' 2026-02-17T11:16:46.850 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:16:46.850 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:16:46.930 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=60129542150 2026-02-17T11:16:46.930 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 60129542150 2026-02-17T11:16:46.930 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836489 1-38654705672 2-60129542150' 2026-02-17T11:16:46.930 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:16:46.931 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836489 2026-02-17T11:16:46.931 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:16:46.932 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:16:46.932 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836489 2026-02-17T11:16:46.933 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:16:46.934 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836489 2026-02-17T11:16:46.934 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 21474836489 2026-02-17T11:16:46.934 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836489' 2026-02-17T11:16:46.934 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:16:47.137 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836487 -lt 21474836489 2026-02-17T11:16:47.137 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:16:48.138 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:16:48.139 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:16:48.348 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836489 -lt 21474836489 2026-02-17T11:16:48.348 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:16:48.349 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705672 2026-02-17T11:16:48.349 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:16:48.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T11:16:48.351 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705672 2026-02-17T11:16:48.351 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:16:48.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705672 2026-02-17T11:16:48.352 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.1 seq 38654705672 2026-02-17T11:16:48.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705672' 2026-02-17T11:16:48.352 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T11:16:48.550 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705672 -lt 38654705672 2026-02-17T11:16:48.551 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:16:48.551 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-60129542150 2026-02-17T11:16:48.551 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:16:48.552 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:16:48.553 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-60129542150 2026-02-17T11:16:48.553 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:16:48.554 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=60129542150 2026-02-17T11:16:48.555 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-17T11:16:48.555 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 60129542150 2026-02-17T11:16:48.555 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:16:48.761 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-17T11:16:48.762 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T11:16:48.763 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:16:48.763 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:16:49.028 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 == 0 2026-02-17T11:16:49.028 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:16:49.028 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:16:49.028 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:16:49.028 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:16:49.028 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:16:49.028 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:16:49.029 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:16:49.223 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=1 2026-02-17T11:16:49.224 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:16:49.224 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:16:49.224 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:16:49.492 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 1 = 1 2026-02-17T11:16:49.492 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T11:16:49.492 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T11:16:49.492 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:447: TEST_divergent_2: ceph pg dump pgs --format=json 2026-02-17T11:16:49.493 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:447: TEST_divergent_2: jq '.pg_stats[0].up_primary' 2026-02-17T11:16:49.689 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:16:49.698 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:447: TEST_divergent_2: local divergent=1 2026-02-17T11:16:49.699 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: echo 'primary and soon to be divergent is 1' 2026-02-17T11:16:49.699 INFO:tasks.workunit.client.0.trial148.stdout:primary and soon to be divergent is 1 2026-02-17T11:16:49.699 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:449: TEST_divergent_2: ceph pg dump pgs 2026-02-17T11:16:49.884 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:16:49.884 INFO:tasks.workunit.client.0.trial148.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T11:16:43.633548+0000 0'0 26:20 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:16:42.441928+0000 0'0 2026-02-17T11:16:42.441928+0000 0 0 periodic scrub scheduled @ 2026-02-18T20:25:38.894475+0000 0 0 2026-02-17T11:16:49.885 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:16:49.885 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:16:49.885 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:16:49.893 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:450: TEST_divergent_2: local non_divergent= 2026-02-17T11:16:49.893 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:451: TEST_divergent_2: for i in $osds 2026-02-17T11:16:49.893 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:453: TEST_divergent_2: '[' 0 = 1 ']' 2026-02-17T11:16:49.893 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:456: TEST_divergent_2: non_divergent=' 0' 2026-02-17T11:16:49.893 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:451: TEST_divergent_2: for i in $osds 2026-02-17T11:16:49.894 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:453: TEST_divergent_2: '[' 1 = 1 ']' 2026-02-17T11:16:49.894 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: continue 2026-02-17T11:16:49.894 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:451: TEST_divergent_2: for i in $osds 2026-02-17T11:16:49.894 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:453: TEST_divergent_2: '[' 2 = 1 ']' 2026-02-17T11:16:49.894 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:456: TEST_divergent_2: non_divergent=' 0 2' 2026-02-17T11:16:49.894 INFO:tasks.workunit.client.0.trial148.stdout:writing initial objects 2026-02-17T11:16:49.895 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:459: TEST_divergent_2: echo 'writing initial objects' 2026-02-17T11:16:49.895 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: seq 1 100 2026-02-17T11:16:49.895 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:49.895 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_1 /etc/fstab 2026-02-17T11:16:49.916 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:49.916 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_2 /etc/fstab 2026-02-17T11:16:49.944 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:49.944 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_3 /etc/fstab 2026-02-17T11:16:49.967 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:49.967 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_4 /etc/fstab 2026-02-17T11:16:49.991 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:49.991 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_5 /etc/fstab 2026-02-17T11:16:50.017 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.018 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_6 /etc/fstab 2026-02-17T11:16:50.041 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.041 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_7 /etc/fstab 2026-02-17T11:16:50.065 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.065 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_8 /etc/fstab 2026-02-17T11:16:50.089 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.089 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_9 /etc/fstab 2026-02-17T11:16:50.115 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.115 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_10 /etc/fstab 2026-02-17T11:16:50.141 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.141 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_11 /etc/fstab 2026-02-17T11:16:50.166 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.166 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_12 /etc/fstab 2026-02-17T11:16:50.192 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.192 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_13 /etc/fstab 2026-02-17T11:16:50.217 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.217 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_14 /etc/fstab 2026-02-17T11:16:50.242 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.242 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_15 /etc/fstab 2026-02-17T11:16:50.262 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.263 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_16 /etc/fstab 2026-02-17T11:16:50.290 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.290 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_17 /etc/fstab 2026-02-17T11:16:50.315 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.315 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_18 /etc/fstab 2026-02-17T11:16:50.343 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.344 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_19 /etc/fstab 2026-02-17T11:16:50.369 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.369 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_20 /etc/fstab 2026-02-17T11:16:50.393 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.393 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_21 /etc/fstab 2026-02-17T11:16:50.417 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.417 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_22 /etc/fstab 2026-02-17T11:16:50.441 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.441 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_23 /etc/fstab 2026-02-17T11:16:50.465 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.465 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_24 /etc/fstab 2026-02-17T11:16:50.489 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.489 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_25 /etc/fstab 2026-02-17T11:16:50.510 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.510 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_26 /etc/fstab 2026-02-17T11:16:50.537 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.538 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_27 /etc/fstab 2026-02-17T11:16:50.563 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.563 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_28 /etc/fstab 2026-02-17T11:16:50.592 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.592 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_29 /etc/fstab 2026-02-17T11:16:50.619 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.619 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_30 /etc/fstab 2026-02-17T11:16:50.646 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.646 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_31 /etc/fstab 2026-02-17T11:16:50.674 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.674 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_32 /etc/fstab 2026-02-17T11:16:50.702 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.702 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_33 /etc/fstab 2026-02-17T11:16:50.728 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.728 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_34 /etc/fstab 2026-02-17T11:16:50.752 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.752 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_35 /etc/fstab 2026-02-17T11:16:50.777 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.777 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_36 /etc/fstab 2026-02-17T11:16:50.798 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.798 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_37 /etc/fstab 2026-02-17T11:16:50.826 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.826 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_38 /etc/fstab 2026-02-17T11:16:50.853 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.853 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_39 /etc/fstab 2026-02-17T11:16:50.881 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.881 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_40 /etc/fstab 2026-02-17T11:16:50.909 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.910 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_41 /etc/fstab 2026-02-17T11:16:50.937 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.937 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_42 /etc/fstab 2026-02-17T11:16:50.958 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.958 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_43 /etc/fstab 2026-02-17T11:16:50.986 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:50.986 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_44 /etc/fstab 2026-02-17T11:16:51.014 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.014 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_45 /etc/fstab 2026-02-17T11:16:51.041 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.041 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_46 /etc/fstab 2026-02-17T11:16:51.069 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.069 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_47 /etc/fstab 2026-02-17T11:16:51.098 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.098 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_48 /etc/fstab 2026-02-17T11:16:51.125 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.125 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_49 /etc/fstab 2026-02-17T11:16:51.153 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.153 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_50 /etc/fstab 2026-02-17T11:16:51.181 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.182 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_51 /etc/fstab 2026-02-17T11:16:51.209 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.210 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_52 /etc/fstab 2026-02-17T11:16:51.237 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.237 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_53 /etc/fstab 2026-02-17T11:16:51.264 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.265 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_54 /etc/fstab 2026-02-17T11:16:51.292 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.293 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_55 /etc/fstab 2026-02-17T11:16:51.321 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.321 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_56 /etc/fstab 2026-02-17T11:16:51.349 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.349 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_57 /etc/fstab 2026-02-17T11:16:51.377 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.377 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_58 /etc/fstab 2026-02-17T11:16:51.405 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.405 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_59 /etc/fstab 2026-02-17T11:16:51.425 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.425 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_60 /etc/fstab 2026-02-17T11:16:51.452 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_61 /etc/fstab 2026-02-17T11:16:51.472 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.473 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_62 /etc/fstab 2026-02-17T11:16:51.499 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.499 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_63 /etc/fstab 2026-02-17T11:16:51.526 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.526 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_64 /etc/fstab 2026-02-17T11:16:51.553 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.553 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_65 /etc/fstab 2026-02-17T11:16:51.574 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.574 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_66 /etc/fstab 2026-02-17T11:16:51.601 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.601 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_67 /etc/fstab 2026-02-17T11:16:51.627 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.627 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_68 /etc/fstab 2026-02-17T11:16:51.647 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.647 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_69 /etc/fstab 2026-02-17T11:16:51.674 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.675 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_70 /etc/fstab 2026-02-17T11:16:51.701 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.701 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_71 /etc/fstab 2026-02-17T11:16:51.729 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.729 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_72 /etc/fstab 2026-02-17T11:16:51.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_73 /etc/fstab 2026-02-17T11:16:51.785 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.785 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_74 /etc/fstab 2026-02-17T11:16:51.812 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.813 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_75 /etc/fstab 2026-02-17T11:16:51.841 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.841 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_76 /etc/fstab 2026-02-17T11:16:51.869 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.869 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_77 /etc/fstab 2026-02-17T11:16:51.897 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.897 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_78 /etc/fstab 2026-02-17T11:16:51.925 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.925 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_79 /etc/fstab 2026-02-17T11:16:51.953 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.953 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_80 /etc/fstab 2026-02-17T11:16:51.981 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:51.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_81 /etc/fstab 2026-02-17T11:16:52.009 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:52.009 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_82 /etc/fstab 2026-02-17T11:16:52.037 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:52.037 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_83 /etc/fstab 2026-02-17T11:16:52.065 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:52.065 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_84 /etc/fstab 2026-02-17T11:16:52.093 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:52.094 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_85 /etc/fstab 2026-02-17T11:16:52.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:52.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_86 /etc/fstab 2026-02-17T11:16:52.150 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:52.150 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_87 /etc/fstab 2026-02-17T11:16:52.178 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:52.178 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_88 /etc/fstab 2026-02-17T11:16:52.206 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:52.206 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_89 /etc/fstab 2026-02-17T11:16:52.234 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:52.234 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_90 /etc/fstab 2026-02-17T11:16:52.262 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:52.262 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_91 /etc/fstab 2026-02-17T11:16:52.289 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:52.289 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_92 /etc/fstab 2026-02-17T11:16:52.311 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:52.311 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_93 /etc/fstab 2026-02-17T11:16:52.341 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:52.341 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_94 /etc/fstab 2026-02-17T11:16:52.369 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:52.369 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_95 /etc/fstab 2026-02-17T11:16:52.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:52.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_96 /etc/fstab 2026-02-17T11:16:52.425 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:52.425 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_97 /etc/fstab 2026-02-17T11:16:52.454 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:52.454 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_98 /etc/fstab 2026-02-17T11:16:52.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:52.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_99 /etc/fstab 2026-02-17T11:16:52.509 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:461: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-17T11:16:52.510 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:463: TEST_divergent_2: rados -p test put existing_100 /etc/fstab 2026-02-17T11:16:52.537 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:466: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T11:16:52.537 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:466: TEST_divergent_2: wait_for_clean 2026-02-17T11:16:52.538 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T11:16:52.538 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T11:16:52.538 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T11:16:52.538 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T11:16:52.539 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T11:16:52.539 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T11:16:52.539 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T11:16:52.539 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T11:16:52.539 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T11:16:52.609 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T11:16:52.609 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T11:16:52.609 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T11:16:52.609 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T11:16:52.609 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:16:52.610 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:16:52.806 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:16:52.806 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:16:52.806 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:16:52.806 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:16:52.806 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:16:52.807 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:16:52.885 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836493 2026-02-17T11:16:52.886 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836493 2026-02-17T11:16:52.886 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836493' 2026-02-17T11:16:52.886 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:16:52.886 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:16:52.969 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=38654705675 2026-02-17T11:16:52.969 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 38654705675 2026-02-17T11:16:52.969 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836493 1-38654705675' 2026-02-17T11:16:52.969 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:16:52.969 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:16:53.044 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=60129542153 2026-02-17T11:16:53.044 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 60129542153 2026-02-17T11:16:53.044 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836493 1-38654705675 2-60129542153' 2026-02-17T11:16:53.044 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:16:53.045 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836493 2026-02-17T11:16:53.045 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:16:53.046 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:16:53.047 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836493 2026-02-17T11:16:53.047 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:16:53.048 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836493 2026-02-17T11:16:53.048 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 21474836493 2026-02-17T11:16:53.048 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836493' 2026-02-17T11:16:53.049 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:16:53.256 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836490 -lt 21474836493 2026-02-17T11:16:53.257 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:16:54.257 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:16:54.258 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:16:54.465 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836493 -lt 21474836493 2026-02-17T11:16:54.465 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:16:54.466 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-38654705675 2026-02-17T11:16:54.466 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:16:54.467 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T11:16:54.468 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-38654705675 2026-02-17T11:16:54.468 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:16:54.469 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=38654705675 2026-02-17T11:16:54.469 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 38654705675' 2026-02-17T11:16:54.470 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.1 seq 38654705675 2026-02-17T11:16:54.470 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T11:16:54.670 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 38654705675 -lt 38654705675 2026-02-17T11:16:54.670 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:16:54.671 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-60129542153 2026-02-17T11:16:54.671 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:16:54.671 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:16:54.672 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-60129542153 2026-02-17T11:16:54.672 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:16:54.674 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=60129542153 2026-02-17T11:16:54.674 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-17T11:16:54.674 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 60129542153 2026-02-17T11:16:54.675 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:16:54.885 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-17T11:16:54.886 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T11:16:54.886 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:16:54.886 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:16:55.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 == 0 2026-02-17T11:16:55.155 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:16:55.155 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:16:55.155 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:16:55.155 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:16:55.155 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:16:55.155 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:16:55.155 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:16:55.358 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=1 2026-02-17T11:16:55.359 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:16:55.359 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:16:55.359 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:16:55.625 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 1 = 1 2026-02-17T11:16:55.625 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T11:16:55.625 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T11:16:55.626 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:468: TEST_divergent_2: get_pg test existing_1 2026-02-17T11:16:55.626 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1093: get_pg: local poolname=test 2026-02-17T11:16:55.626 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1094: get_pg: local objectname=existing_1 2026-02-17T11:16:55.626 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: ceph --format json osd map test existing_1 2026-02-17T11:16:55.626 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: jq -r .pgid 2026-02-17T11:16:55.829 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:468: TEST_divergent_2: local pgid=1.0 2026-02-17T11:16:55.829 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:471: TEST_divergent_2: echo 'blackholing osds 0 2' 2026-02-17T11:16:55.829 INFO:tasks.workunit.client.0.trial148.stdout:blackholing osds 0 2 2026-02-17T11:16:55.830 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:472: TEST_divergent_2: ceph pg dump pgs 2026-02-17T11:16:56.021 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:16:56.021 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 0 0 0 69500 0 0 16 84 16 active+clean 2026-02-17T11:16:43.633548+0000 26'100 26:120 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:16:42.441928+0000 0'0 2026-02-17T11:16:42.441928+0000 0 0 periodic scrub scheduled @ 2026-02-18T20:25:38.894475+0000 0 0 2026-02-17T11:16:56.021 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:16:56.021 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:16:56.021 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:16:56.031 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:473: TEST_divergent_2: for i in $non_divergent 2026-02-17T11:16:56.032 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:475: TEST_divergent_2: get_asok_path osd.0 2026-02-17T11:16:56.032 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T11:16:56.032 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T11:16:56.032 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:16:56.032 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:16:56.032 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:16:56.032 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.0.asok 2026-02-17T11:16:56.033 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:475: TEST_divergent_2: CEPH_ARGS= 2026-02-17T11:16:56.033 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:475: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-17T11:16:56.088 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:16:56.088 INFO:tasks.workunit.client.0.trial148.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T11:16:56.088 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:16:56.094 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:473: TEST_divergent_2: for i in $non_divergent 2026-02-17T11:16:56.095 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:475: TEST_divergent_2: get_asok_path osd.2 2026-02-17T11:16:56.095 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2026-02-17T11:16:56.095 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2026-02-17T11:16:56.095 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:16:56.095 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:16:56.095 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:16:56.095 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.2.asok 2026-02-17T11:16:56.096 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:475: TEST_divergent_2: CEPH_ARGS= 2026-02-17T11:16:56.096 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:475: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-17T11:16:56.147 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:16:56.148 INFO:tasks.workunit.client.0.trial148.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T11:16:56.148 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:16:56.153 INFO:tasks.workunit.client.0.trial148.stdout:create new divergent objects 2026-02-17T11:16:56.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:479: TEST_divergent_2: echo 'create new divergent objects' 2026-02-17T11:16:56.154 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:480: TEST_divergent_2: seq 1 2 2026-02-17T11:16:56.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:480: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T11:16:56.155 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:480: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T11:16:56.155 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:482: TEST_divergent_2: rados -p test create newobject_1 2026-02-17T11:16:56.155 INFO:tasks.workunit.client.0.trial148.stdout:writing divergent objects 2026-02-17T11:16:56.156 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:485: TEST_divergent_2: echo 'writing divergent objects' 2026-02-17T11:16:56.156 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:482: TEST_divergent_2: rados -p test create newobject_2 2026-02-17T11:16:56.156 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:486: TEST_divergent_2: seq 1 2 2026-02-17T11:16:56.156 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:486: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-17T11:16:56.157 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:486: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-17T11:16:56.157 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:488: TEST_divergent_2: rados -p test put existing_1 /etc/resolv.conf 2026-02-17T11:16:56.157 INFO:tasks.workunit.client.0.trial148.stdout:remove divergent objects 2026-02-17T11:16:56.158 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:491: TEST_divergent_2: echo 'remove divergent objects' 2026-02-17T11:16:56.158 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:488: TEST_divergent_2: rados -p test put existing_2 /etc/resolv.conf 2026-02-17T11:16:56.158 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:492: TEST_divergent_2: seq 1 2 2026-02-17T11:16:56.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:492: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-17T11:16:56.159 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:494: TEST_divergent_2: expr 1 + 2 2026-02-17T11:16:56.160 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:494: TEST_divergent_2: rmi=3 2026-02-17T11:16:56.160 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:492: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-17T11:16:56.160 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rados -p test rm existing_3 2026-02-17T11:16:56.161 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:494: TEST_divergent_2: expr 2 + 2 2026-02-17T11:16:56.162 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:494: TEST_divergent_2: rmi=4 2026-02-17T11:16:56.162 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:497: TEST_divergent_2: sleep 10 2026-02-17T11:16:56.162 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rados -p test rm existing_4 2026-02-17T11:17:06.163 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:498: TEST_divergent_2: killall -9 rados 2026-02-17T11:17:06.204 INFO:tasks.workunit.client.0.trial148.stderr:rados: no process found 2026-02-17T11:17:06.204 INFO:tasks.workunit.client.0.trial148.stdout:killing all the osds 2026-02-17T11:17:06.204 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:501: TEST_divergent_2: echo 'killing all the osds' 2026-02-17T11:17:06.204 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:502: TEST_divergent_2: ceph pg dump pgs 2026-02-17T11:17:06.404 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:17:06.404 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 0 0 0 68654 0 0 16 90 16 active+clean 2026-02-17T11:16:43.633548+0000 26'106 26:126 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:16:42.441928+0000 0'0 2026-02-17T11:16:42.441928+0000 0 0 periodic scrub scheduled @ 2026-02-18T20:25:38.894475+0000 0 0 2026-02-17T11:17:06.405 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:17:06.405 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:17:06.405 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:17:06.412 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:503: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd 2026-02-17T11:17:06.413 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:17:06.413 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:17:06.414 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:17:06.414 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:17:06.414 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:17:06.521 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:17:06.521 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:504: TEST_divergent_2: for i in $osds 2026-02-17T11:17:06.521 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:506: TEST_divergent_2: ceph osd down osd.0 2026-02-17T11:17:06.778 INFO:tasks.workunit.client.0.trial148.stderr:osd.0 is already down. 2026-02-17T11:17:06.788 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:504: TEST_divergent_2: for i in $osds 2026-02-17T11:17:06.788 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:506: TEST_divergent_2: ceph osd down osd.1 2026-02-17T11:17:07.048 INFO:tasks.workunit.client.0.trial148.stderr:osd.1 is already down. 2026-02-17T11:17:07.057 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:504: TEST_divergent_2: for i in $osds 2026-02-17T11:17:07.057 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:506: TEST_divergent_2: ceph osd down osd.2 2026-02-17T11:17:07.356 INFO:tasks.workunit.client.0.trial148.stderr:osd.2 is already down. 2026-02-17T11:17:07.366 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:508: TEST_divergent_2: for i in $non_divergent 2026-02-17T11:17:07.366 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:510: TEST_divergent_2: ceph osd out osd.0 2026-02-17T11:17:07.656 INFO:tasks.workunit.client.0.trial148.stderr:osd.0 is already out. 2026-02-17T11:17:07.665 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:508: TEST_divergent_2: for i in $non_divergent 2026-02-17T11:17:07.666 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:510: TEST_divergent_2: ceph osd out osd.2 2026-02-17T11:17:07.934 INFO:tasks.workunit.client.0.trial148.stderr:osd.2 is already out. 2026-02-17T11:17:07.944 INFO:tasks.workunit.client.0.trial148.stdout:bringing up non_divergent 0 2 2026-02-17T11:17:07.945 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:514: TEST_divergent_2: echo 'bringing up non_divergent 0 2' 2026-02-17T11:17:07.945 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:515: TEST_divergent_2: ceph pg dump pgs 2026-02-17T11:17:08.151 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:17:08.151 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 0 0 0 68654 0 0 16 90 16 stale+active+clean 2026-02-17T11:16:43.633548+0000 26'106 26:126 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:16:42.441928+0000 0'0 2026-02-17T11:16:42.441928+0000 0 0 periodic scrub scheduled @ 2026-02-18T20:25:38.894475+0000 0 0 2026-02-17T11:17:08.151 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:17:08.151 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:17:08.151 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:17:08.163 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:516: TEST_divergent_2: for i in $non_divergent 2026-02-17T11:17:08.163 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:518: TEST_divergent_2: activate_osd td/divergent-priors 0 2026-02-17T11:17:08.163 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/divergent-priors 2026-02-17T11:17:08.163 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:17:08.163 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=0 2026-02-17T11:17:08.164 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:17:08.164 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T11:17:08.164 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:17:08.164 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:17:08.164 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:17:08.164 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:17:08.164 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T11:17:08.164 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T11:17:08.164 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:17:08.164 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:17:08.164 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:17:08.164 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:17:08.165 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:17:08.165 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:17:08.165 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:17:08.165 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:17:08.165 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:17:08.165 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:17:08.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:17:08.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:17:08.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:17:08.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:17:08.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:17:08.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:17:08.166 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:17:08.166 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:17:08.166 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:17:08.166 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:17:08.166 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T11:17:08.166 INFO:tasks.workunit.client.0.trial148.stdout:start osd.0 2026-02-17T11:17:08.167 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.0 2026-02-17T11:17:08.167 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 0 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:17:08.168 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T11:17:08.168 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 0 = 0 ']' 2026-02-17T11:17:08.168 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:17:08.168 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:17:08.168 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:17:08.188 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:17:08.185+0000 7f7f54bd88c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:17:08.189 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:17:08.185+0000 7f7f54bd88c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:17:08.190 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:17:08.185+0000 7f7f54bd88c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:17:08.367 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 0 2026-02-17T11:17:08.367 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:17:08.367 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T11:17:08.368 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:17:08.368 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:17:08.368 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:17:08.368 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:17:08.368 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:17:08.369 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:17:08.369 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:17:08.576 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:17:09.469 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:17:09.465+0000 7f7f54bd88c0 -1 Falling back to public interface 2026-02-17T11:17:09.577 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:17:09.577 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:17:09.577 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:17:09.577 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:17:09.577 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:17:09.577 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:17:09.781 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:17:10.782 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:17:10.782 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:17:10.783 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:17:10.783 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:17:10.783 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:17:10.783 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:17:10.994 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:17:11.994 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:17:11.995 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:17:11.995 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:17:11.995 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:17:11.995 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:17:11.995 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:17:12.197 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:17:12.497 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:17:12.494+0000 7f7f54bd88c0 -1 osd.0 26 log_to_monitors true 2026-02-17T11:17:13.198 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:17:13.199 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:17:13.199 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:17:13.199 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:17:13.200 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:17:13.200 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:17:13.401 INFO:tasks.workunit.client.0.trial148.stdout:osd.0 up out weight 0 up_from 33 up_thru 0 down_at 27 last_clean_interval [5,26) [v2:127.0.0.1:6802/2678757997,v1:127.0.0.1:6803/2678757997] [v2:127.0.0.1:6804/2678757997,v1:127.0.0.1:6805/2678757997] exists,up c8aaf815-94b1-4949-96b2-b16a33de34d1 2026-02-17T11:17:13.405 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:17:13.405 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:17:13.405 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:17:13.405 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:516: TEST_divergent_2: for i in $non_divergent 2026-02-17T11:17:13.405 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:518: TEST_divergent_2: activate_osd td/divergent-priors 2 2026-02-17T11:17:13.405 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/divergent-priors 2026-02-17T11:17:13.405 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:17:13.406 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T11:17:13.406 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:17:13.406 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T11:17:13.406 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:17:13.406 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:17:13.406 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:17:13.406 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:17:13.406 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T11:17:13.406 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T11:17:13.406 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:17:13.406 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:17:13.407 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:17:13.407 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:17:13.407 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:17:13.407 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:17:13.407 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:17:13.407 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:17:13.407 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:17:13.407 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:17:13.407 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:17:13.407 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:17:13.407 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:17:13.407 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:17:13.408 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:17:13.408 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:17:13.408 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:17:13.408 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:17:13.408 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:17:13.408 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:17:13.408 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T11:17:13.408 INFO:tasks.workunit.client.0.trial148.stdout:start osd.2 2026-02-17T11:17:13.410 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T11:17:13.410 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:17:13.410 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T11:17:13.410 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T11:17:13.410 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:17:13.410 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:17:13.410 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:17:13.430 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:17:13.430+0000 7fc666cba8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:17:13.432 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:17:13.430+0000 7fc666cba8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:17:13.433 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:17:13.430+0000 7fc666cba8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:17:13.609 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T11:17:13.609 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:17:13.610 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T11:17:13.610 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:17:13.610 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:17:13.610 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:17:13.610 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:17:13.611 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:17:13.612 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:17:13.612 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:17:13.815 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:17:14.704 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:17:14.702+0000 7fc666cba8c0 -1 Falling back to public interface 2026-02-17T11:17:14.816 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:17:14.816 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:17:14.816 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:17:14.816 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:17:14.816 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:17:14.816 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:17:15.020 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:17:16.021 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:17:16.021 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:17:16.022 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:17:16.022 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:17:16.023 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:17:16.023 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:17:16.226 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:17:17.227 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:17:17.228 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:17:17.228 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:17:17.229 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:17:17.229 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:17:17.229 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:17:17.431 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:17:17.941 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:17:17.938+0000 7fc666cba8c0 -1 osd.2 26 log_to_monitors true 2026-02-17T11:17:18.432 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:17:18.432 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:17:18.432 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:17:18.433 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:17:18.433 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:17:18.433 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:17:18.640 INFO:tasks.workunit.client.0.trial148.stdout:osd.2 up out weight 0 up_from 36 up_thru 0 down_at 29 last_clean_interval [14,26) [v2:127.0.0.1:6810/494313416,v1:127.0.0.1:6811/494313416] [v2:127.0.0.1:6812/494313416,v1:127.0.0.1:6813/494313416] exists,up 444f54f7-411d-409e-9057-71f2cbbc5258 2026-02-17T11:17:18.640 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:17:18.640 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:17:18.640 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:17:18.640 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:520: TEST_divergent_2: for i in $non_divergent 2026-02-17T11:17:18.640 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:522: TEST_divergent_2: ceph osd in osd.0 2026-02-17T11:17:18.887 INFO:tasks.workunit.client.0.trial148.stderr:osd.0 is already in. 2026-02-17T11:17:18.898 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:520: TEST_divergent_2: for i in $non_divergent 2026-02-17T11:17:18.898 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:522: TEST_divergent_2: ceph osd in osd.2 2026-02-17T11:17:19.192 INFO:tasks.workunit.client.0.trial148.stderr:osd.2 is already in. 2026-02-17T11:17:19.204 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:525: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T11:17:19.204 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:525: TEST_divergent_2: wait_for_clean 2026-02-17T11:17:19.204 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T11:17:19.204 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T11:17:19.204 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T11:17:19.204 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T11:17:19.204 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T11:17:19.205 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T11:17:19.205 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T11:17:19.205 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T11:17:19.205 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T11:17:19.269 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T11:17:19.269 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T11:17:19.269 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T11:17:19.269 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T11:17:19.269 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:17:19.269 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:17:19.465 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:17:19.465 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:17:19.466 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:17:19.466 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:17:19.466 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:17:19.466 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:17:19.545 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=141733920772 2026-02-17T11:17:19.545 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 141733920772 2026-02-17T11:17:19.545 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-141733920772' 2026-02-17T11:17:19.546 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:17:19.546 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:17:19.604 INFO:tasks.workunit.client.0.trial148.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-17T11:17:19.607 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq= 2026-02-17T11:17:19.607 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z '' 2026-02-17T11:17:19.607 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: continue 2026-02-17T11:17:19.607 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:17:19.607 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:17:19.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=154618822659 2026-02-17T11:17:19.685 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 154618822659 2026-02-17T11:17:19.685 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-141733920772 2-154618822659' 2026-02-17T11:17:19.685 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:17:19.685 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-141733920772 2026-02-17T11:17:19.686 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:17:19.686 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:17:19.687 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-141733920772 2026-02-17T11:17:19.687 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:17:19.688 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=141733920772 2026-02-17T11:17:19.689 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 141733920772' 2026-02-17T11:17:19.689 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 141733920772 2026-02-17T11:17:19.689 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:17:19.902 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 141733920770 -lt 141733920772 2026-02-17T11:17:19.903 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:17:20.904 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:17:20.904 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:17:21.113 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 141733920770 -lt 141733920772 2026-02-17T11:17:21.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:17:22.115 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T11:17:22.115 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:17:22.316 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 141733920772 -lt 141733920772 2026-02-17T11:17:22.316 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:17:22.317 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-154618822659 2026-02-17T11:17:22.317 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:17:22.318 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:17:22.319 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-154618822659 2026-02-17T11:17:22.319 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:17:22.320 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=154618822659 2026-02-17T11:17:22.320 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 154618822659' 2026-02-17T11:17:22.320 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 154618822659 2026-02-17T11:17:22.321 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:17:22.533 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 154618822659 -lt 154618822659 2026-02-17T11:17:22.534 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T11:17:22.534 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:17:22.534 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:17:22.802 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 == 0 2026-02-17T11:17:22.802 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:17:22.803 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:17:22.803 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:17:22.803 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:17:22.803 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:17:22.803 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:17:22.803 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:17:23.004 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:17:23.004 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:17:23.005 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:17:23.005 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:17:23.270 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:17:23.270 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' -1 2026-02-17T11:17:23.270 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: loop=0 2026-02-17T11:17:23.270 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: num_active_clean=0 2026-02-17T11:17:23.271 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:17:23.271 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.1 2026-02-17T11:17:23.370 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:17:23.370 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:17:23.371 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:17:23.371 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:17:23.371 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:17:23.371 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:17:23.371 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:17:23.371 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:17:23.565 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:17:23.566 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:17:23.567 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:17:23.567 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:17:23.823 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:17:23.823 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:17:23.823 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:17:23.823 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:17:23.823 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:17:23.823 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:17:23.823 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:17:23.823 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:17:23.823 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:17:24.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:17:24.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:17:24.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 1 >= 8 )) 2026-02-17T11:17:24.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:17:24.085 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.2 2026-02-17T11:17:24.283 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:17:24.283 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:17:24.283 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:17:24.283 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:17:24.283 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:17:24.283 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:17:24.284 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:17:24.284 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:17:24.490 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:17:24.491 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:17:24.491 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:17:24.491 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:17:24.766 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:17:24.766 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:17:24.766 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:17:24.766 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:17:24.766 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:17:24.766 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:17:24.766 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:17:24.767 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:17:24.767 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:17:25.042 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:17:25.042 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:17:25.043 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 2 >= 8 )) 2026-02-17T11:17:25.043 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:17:25.043 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.4 2026-02-17T11:17:25.443 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:17:25.443 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:17:25.443 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:17:25.443 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:17:25.443 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:17:25.443 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:17:25.444 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:17:25.444 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:17:25.647 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:17:25.647 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:17:25.648 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:17:25.648 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:17:25.917 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:17:25.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:17:25.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:17:25.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:17:25.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:17:25.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:17:25.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:17:25.918 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:17:25.918 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:17:26.187 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:17:26.187 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:17:26.187 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 3 >= 8 )) 2026-02-17T11:17:26.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:17:26.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.8 2026-02-17T11:17:26.988 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:17:26.988 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:17:26.989 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:17:26.989 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:17:26.989 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:17:26.989 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:17:26.989 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:17:26.989 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:17:27.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:17:27.188 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:17:27.189 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:17:27.189 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:17:27.449 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:17:27.450 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:17:27.450 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:17:27.450 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:17:27.450 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:17:27.450 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:17:27.450 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:17:27.450 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:17:27.450 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:17:27.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:17:27.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:17:27.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 4 >= 8 )) 2026-02-17T11:17:27.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:17:27.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 1.6 2026-02-17T11:17:29.312 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:17:29.312 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:17:29.312 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:17:29.312 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:17:29.312 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:17:29.312 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:17:29.312 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:17:29.313 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:17:29.505 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:17:29.505 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:17:29.506 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:17:29.506 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:17:29.774 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:17:29.774 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:17:29.775 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:17:29.775 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:17:29.775 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:17:29.775 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:17:29.775 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:17:29.775 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:17:29.775 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:17:30.047 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:17:30.047 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:17:30.048 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 5 >= 8 )) 2026-02-17T11:17:30.048 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:17:30.048 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 3.2 2026-02-17T11:17:33.248 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:17:33.249 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:17:33.249 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:17:33.249 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:17:33.249 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:17:33.249 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:17:33.250 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:17:33.250 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:17:33.458 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:17:33.459 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:17:33.459 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:17:33.459 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:17:33.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:17:33.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:17:33.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:17:33.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:17:33.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:17:33.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:17:33.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:17:33.732 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:17:33.732 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:17:33.999 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:17:33.999 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:17:33.999 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 6 >= 8 )) 2026-02-17T11:17:33.999 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:17:33.999 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 6.4 2026-02-17T11:17:40.399 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:17:40.400 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:17:40.400 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:17:40.400 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:17:40.400 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:17:40.400 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:17:40.401 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:17:40.401 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:17:40.604 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:17:40.604 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:17:40.605 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:17:40.605 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:17:40.877 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:17:40.877 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:17:40.877 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:17:40.877 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:17:40.877 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:17:40.877 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:17:40.877 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:17:40.878 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:17:40.878 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:17:41.142 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:17:41.143 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:17:41.143 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 7 >= 8 )) 2026-02-17T11:17:41.143 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:17:41.143 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 7.3 2026-02-17T11:17:48.443 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:17:48.443 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:17:48.444 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:17:48.444 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:17:48.444 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:17:48.444 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:17:48.445 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:17:48.445 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:17:48.645 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:17:48.645 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:17:48.646 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:17:48.646 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:17:48.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:17:48.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:17:48.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:17:48.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:17:48.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:17:48.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:17:48.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:17:48.909 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:17:48.909 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:17:49.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:17:49.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:17:49.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 8 >= 8 )) 2026-02-17T11:17:49.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1679: wait_for_clean: ceph report 2026-02-17T11:17:49.433 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:17:49.434 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_fingerprint": "05a0446c-1c0a-4b8c-9835-09c9a32ebe5e", 2026-02-17T11:17:49.434 INFO:tasks.workunit.client.0.trial148.stdout: "version": "19.2.3-705-g04cf6dd4", 2026-02-17T11:17:49.434 INFO:tasks.workunit.client.0.trial148.stdout: "commit": "04cf6dd4be446d06026adad18a5fbf5da1fa8c0e", 2026-02-17T11:17:49.434 INFO:tasks.workunit.client.0.trial148.stdout: "timestamp": "2026-02-17T11:17:49.432917+0000", 2026-02-17T11:17:49.434 INFO:tasks.workunit.client.0.trial148.stdout: "tag": "", 2026-02-17T11:17:49.434 INFO:tasks.workunit.client.0.trial148.stdout: "health": { 2026-02-17T11:17:49.434 INFO:tasks.workunit.client.0.trial148.stdout: "status": "HEALTH_WARN", 2026-02-17T11:17:49.434 INFO:tasks.workunit.client.0.trial148.stdout: "checks": { 2026-02-17T11:17:49.435 INFO:tasks.workunit.client.0.trial148.stdout: "OSDMAP_FLAGS": { 2026-02-17T11:17:49.435 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:17:49.435 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:17:49.435 INFO:tasks.workunit.client.0.trial148.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T11:17:49.435 INFO:tasks.workunit.client.0.trial148.stdout: "count": 17 2026-02-17T11:17:49.435 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.435 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [], 2026-02-17T11:17:49.435 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:17:49.435 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.435 INFO:tasks.workunit.client.0.trial148.stdout: "OSD_DOWN": { 2026-02-17T11:17:49.435 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:17:49.435 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:17:49.436 INFO:tasks.workunit.client.0.trial148.stdout: "message": "1 osds down", 2026-02-17T11:17:49.436 INFO:tasks.workunit.client.0.trial148.stdout: "count": 1 2026-02-17T11:17:49.436 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.436 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:17:49.436 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.436 INFO:tasks.workunit.client.0.trial148.stdout: "message": "osd.1 (root=default,host=trial148) is down" 2026-02-17T11:17:49.436 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.436 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:17:49.436 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:17:49.436 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.436 INFO:tasks.workunit.client.0.trial148.stdout: "PG_DEGRADED": { 2026-02-17T11:17:49.436 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:17:49.437 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:17:49.437 INFO:tasks.workunit.client.0.trial148.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-17T11:17:49.437 INFO:tasks.workunit.client.0.trial148.stdout: "count": 1 2026-02-17T11:17:49.437 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.437 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:17:49.437 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.437 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:17:49.437 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.437 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:17:49.437 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:17:49.437 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.437 INFO:tasks.workunit.client.0.trial148.stdout: "POOL_APP_NOT_ENABLED": { 2026-02-17T11:17:49.438 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:17:49.438 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:17:49.438 INFO:tasks.workunit.client.0.trial148.stdout: "message": "1 pool(s) do not have an application enabled", 2026-02-17T11:17:49.438 INFO:tasks.workunit.client.0.trial148.stdout: "count": 1 2026-02-17T11:17:49.438 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.438 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:17:49.438 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.438 INFO:tasks.workunit.client.0.trial148.stdout: "message": "application not enabled on pool 'test'" 2026-02-17T11:17:49.438 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.438 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.438 INFO:tasks.workunit.client.0.trial148.stdout: "message": "use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." 2026-02-17T11:17:49.438 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.438 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:17:49.439 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:17:49.439 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.439 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.439 INFO:tasks.workunit.client.0.trial148.stdout: "mutes": [] 2026-02-17T11:17:49.439 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.439 INFO:tasks.workunit.client.0.trial148.stdout: "monmap_first_committed": 1, 2026-02-17T11:17:49.439 INFO:tasks.workunit.client.0.trial148.stdout: "monmap_last_committed": 1, 2026-02-17T11:17:49.439 INFO:tasks.workunit.client.0.trial148.stdout: "monmap": { 2026-02-17T11:17:49.440 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 1, 2026-02-17T11:17:49.440 INFO:tasks.workunit.client.0.trial148.stdout: "fsid": "0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a", 2026-02-17T11:17:49.440 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:16:12.896056Z", 2026-02-17T11:17:49.440 INFO:tasks.workunit.client.0.trial148.stdout: "created": "2026-02-17T11:16:12.896056Z", 2026-02-17T11:17:49.440 INFO:tasks.workunit.client.0.trial148.stdout: "min_mon_release": 19, 2026-02-17T11:17:49.440 INFO:tasks.workunit.client.0.trial148.stdout: "min_mon_release_name": "squid", 2026-02-17T11:17:49.440 INFO:tasks.workunit.client.0.trial148.stdout: "election_strategy": 1, 2026-02-17T11:17:49.440 INFO:tasks.workunit.client.0.trial148.stdout: "disallowed_leaders": "", 2026-02-17T11:17:49.440 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode": false, 2026-02-17T11:17:49.440 INFO:tasks.workunit.client.0.trial148.stdout: "tiebreaker_mon": "", 2026-02-17T11:17:49.440 INFO:tasks.workunit.client.0.trial148.stdout: "removed_ranks": "", 2026-02-17T11:17:49.440 INFO:tasks.workunit.client.0.trial148.stdout: "features": { 2026-02-17T11:17:49.440 INFO:tasks.workunit.client.0.trial148.stdout: "persistent": [ 2026-02-17T11:17:49.441 INFO:tasks.workunit.client.0.trial148.stdout: "kraken", 2026-02-17T11:17:49.441 INFO:tasks.workunit.client.0.trial148.stdout: "luminous", 2026-02-17T11:17:49.441 INFO:tasks.workunit.client.0.trial148.stdout: "mimic", 2026-02-17T11:17:49.441 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap-prune", 2026-02-17T11:17:49.441 INFO:tasks.workunit.client.0.trial148.stdout: "nautilus", 2026-02-17T11:17:49.441 INFO:tasks.workunit.client.0.trial148.stdout: "octopus", 2026-02-17T11:17:49.441 INFO:tasks.workunit.client.0.trial148.stdout: "pacific", 2026-02-17T11:17:49.441 INFO:tasks.workunit.client.0.trial148.stdout: "elector-pinging", 2026-02-17T11:17:49.441 INFO:tasks.workunit.client.0.trial148.stdout: "quincy", 2026-02-17T11:17:49.441 INFO:tasks.workunit.client.0.trial148.stdout: "reef", 2026-02-17T11:17:49.441 INFO:tasks.workunit.client.0.trial148.stdout: "squid" 2026-02-17T11:17:49.441 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:17:49.441 INFO:tasks.workunit.client.0.trial148.stdout: "optional": [] 2026-02-17T11:17:49.442 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.442 INFO:tasks.workunit.client.0.trial148.stdout: "mons": [ 2026-02-17T11:17:49.442 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.442 INFO:tasks.workunit.client.0.trial148.stdout: "rank": 0, 2026-02-17T11:17:49.442 INFO:tasks.workunit.client.0.trial148.stdout: "name": "a", 2026-02-17T11:17:49.442 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:17:49.442 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:17:49.442 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.442 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:17:49.442 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:7115", 2026-02-17T11:17:49.442 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 0 2026-02-17T11:17:49.442 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.442 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.443 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.443 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T11:17:49.443 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T11:17:49.443 INFO:tasks.workunit.client.0.trial148.stdout: "priority": 0, 2026-02-17T11:17:49.443 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 0, 2026-02-17T11:17:49.443 INFO:tasks.workunit.client.0.trial148.stdout: "crush_location": "{}" 2026-02-17T11:17:49.443 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.443 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.443 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.443 INFO:tasks.workunit.client.0.trial148.stdout: "quorum": [ 2026-02-17T11:17:49.443 INFO:tasks.workunit.client.0.trial148.stdout: 0 2026-02-17T11:17:49.443 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:17:49.443 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap": { 2026-02-17T11:17:49.444 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 40, 2026-02-17T11:17:49.444 INFO:tasks.workunit.client.0.trial148.stdout: "fsid": "0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a", 2026-02-17T11:17:49.444 INFO:tasks.workunit.client.0.trial148.stdout: "created": "2026-02-17T11:16:12.975477+0000", 2026-02-17T11:17:49.444 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:17:19.243060+0000", 2026-02-17T11:17:49.444 INFO:tasks.workunit.client.0.trial148.stdout: "last_up_change": "2026-02-17T11:17:18.096419+0000", 2026-02-17T11:17:49.444 INFO:tasks.workunit.client.0.trial148.stdout: "last_in_change": "2026-02-17T11:17:19.140812+0000", 2026-02-17T11:17:49.444 INFO:tasks.workunit.client.0.trial148.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T11:17:49.444 INFO:tasks.workunit.client.0.trial148.stdout: "flags_num": 5800384, 2026-02-17T11:17:49.444 INFO:tasks.workunit.client.0.trial148.stdout: "flags_set": [ 2026-02-17T11:17:49.444 INFO:tasks.workunit.client.0.trial148.stdout: "nodown", 2026-02-17T11:17:49.444 INFO:tasks.workunit.client.0.trial148.stdout: "noin", 2026-02-17T11:17:49.444 INFO:tasks.workunit.client.0.trial148.stdout: "noout", 2026-02-17T11:17:49.445 INFO:tasks.workunit.client.0.trial148.stdout: "pglog_hardlimit", 2026-02-17T11:17:49.445 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snapdirs", 2026-02-17T11:17:49.445 INFO:tasks.workunit.client.0.trial148.stdout: "recovery_deletes", 2026-02-17T11:17:49.445 INFO:tasks.workunit.client.0.trial148.stdout: "sortbitwise" 2026-02-17T11:17:49.445 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:17:49.445 INFO:tasks.workunit.client.0.trial148.stdout: "crush_version": 9, 2026-02-17T11:17:49.445 INFO:tasks.workunit.client.0.trial148.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T11:17:49.445 INFO:tasks.workunit.client.0.trial148.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T11:17:49.445 INFO:tasks.workunit.client.0.trial148.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T11:17:49.445 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_snapshot": "", 2026-02-17T11:17:49.445 INFO:tasks.workunit.client.0.trial148.stdout: "pool_max": 1, 2026-02-17T11:17:49.445 INFO:tasks.workunit.client.0.trial148.stdout: "max_osd": 3, 2026-02-17T11:17:49.445 INFO:tasks.workunit.client.0.trial148.stdout: "require_min_compat_client": "luminous", 2026-02-17T11:17:49.446 INFO:tasks.workunit.client.0.trial148.stdout: "min_compat_client": "jewel", 2026-02-17T11:17:49.446 INFO:tasks.workunit.client.0.trial148.stdout: "require_osd_release": "squid", 2026-02-17T11:17:49.446 INFO:tasks.workunit.client.0.trial148.stdout: "allow_crimson": false, 2026-02-17T11:17:49.446 INFO:tasks.workunit.client.0.trial148.stdout: "pools": [ 2026-02-17T11:17:49.446 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.446 INFO:tasks.workunit.client.0.trial148.stdout: "pool": 1, 2026-02-17T11:17:49.446 INFO:tasks.workunit.client.0.trial148.stdout: "pool_name": "test", 2026-02-17T11:17:49.446 INFO:tasks.workunit.client.0.trial148.stdout: "create_time": "2026-02-17T11:16:42.402898+0000", 2026-02-17T11:17:49.446 INFO:tasks.workunit.client.0.trial148.stdout: "flags": 1, 2026-02-17T11:17:49.446 INFO:tasks.workunit.client.0.trial148.stdout: "flags_names": "hashpspool", 2026-02-17T11:17:49.446 INFO:tasks.workunit.client.0.trial148.stdout: "type": 1, 2026-02-17T11:17:49.446 INFO:tasks.workunit.client.0.trial148.stdout: "size": 3, 2026-02-17T11:17:49.446 INFO:tasks.workunit.client.0.trial148.stdout: "min_size": 2, 2026-02-17T11:17:49.447 INFO:tasks.workunit.client.0.trial148.stdout: "crush_rule": 0, 2026-02-17T11:17:49.447 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_count": 0, 2026-02-17T11:17:49.447 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_target": 0, 2026-02-17T11:17:49.447 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T11:17:49.447 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T11:17:49.447 INFO:tasks.workunit.client.0.trial148.stdout: "is_stretch_pool": false, 2026-02-17T11:17:49.447 INFO:tasks.workunit.client.0.trial148.stdout: "object_hash": 2, 2026-02-17T11:17:49.447 INFO:tasks.workunit.client.0.trial148.stdout: "pg_autoscale_mode": "off", 2026-02-17T11:17:49.447 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num": 1, 2026-02-17T11:17:49.447 INFO:tasks.workunit.client.0.trial148.stdout: "pg_placement_num": 1, 2026-02-17T11:17:49.447 INFO:tasks.workunit.client.0.trial148.stdout: "pg_placement_num_target": 1, 2026-02-17T11:17:49.447 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num_target": 1, 2026-02-17T11:17:49.447 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num_pending": 1, 2026-02-17T11:17:49.448 INFO:tasks.workunit.client.0.trial148.stdout: "last_pg_merge_meta": { 2026-02-17T11:17:49.448 INFO:tasks.workunit.client.0.trial148.stdout: "source_pgid": "0.0", 2026-02-17T11:17:49.448 INFO:tasks.workunit.client.0.trial148.stdout: "ready_epoch": 0, 2026-02-17T11:17:49.448 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_started": 0, 2026-02-17T11:17:49.448 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_clean": 0, 2026-02-17T11:17:49.448 INFO:tasks.workunit.client.0.trial148.stdout: "source_version": "0'0", 2026-02-17T11:17:49.448 INFO:tasks.workunit.client.0.trial148.stdout: "target_version": "0'0" 2026-02-17T11:17:49.448 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.448 INFO:tasks.workunit.client.0.trial148.stdout: "last_change": "26", 2026-02-17T11:17:49.448 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend": "0", 2026-02-17T11:17:49.448 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T11:17:49.448 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T11:17:49.448 INFO:tasks.workunit.client.0.trial148.stdout: "auid": 0, 2026-02-17T11:17:49.449 INFO:tasks.workunit.client.0.trial148.stdout: "snap_mode": "selfmanaged", 2026-02-17T11:17:49.449 INFO:tasks.workunit.client.0.trial148.stdout: "snap_seq": 0, 2026-02-17T11:17:49.449 INFO:tasks.workunit.client.0.trial148.stdout: "snap_epoch": 0, 2026-02-17T11:17:49.449 INFO:tasks.workunit.client.0.trial148.stdout: "pool_snaps": [], 2026-02-17T11:17:49.449 INFO:tasks.workunit.client.0.trial148.stdout: "removed_snaps": "[]", 2026-02-17T11:17:49.449 INFO:tasks.workunit.client.0.trial148.stdout: "quota_max_bytes": 0, 2026-02-17T11:17:49.449 INFO:tasks.workunit.client.0.trial148.stdout: "quota_max_objects": 0, 2026-02-17T11:17:49.449 INFO:tasks.workunit.client.0.trial148.stdout: "tiers": [], 2026-02-17T11:17:49.449 INFO:tasks.workunit.client.0.trial148.stdout: "tier_of": -1, 2026-02-17T11:17:49.449 INFO:tasks.workunit.client.0.trial148.stdout: "read_tier": -1, 2026-02-17T11:17:49.449 INFO:tasks.workunit.client.0.trial148.stdout: "write_tier": -1, 2026-02-17T11:17:49.450 INFO:tasks.workunit.client.0.trial148.stdout: "cache_mode": "none", 2026-02-17T11:17:49.450 INFO:tasks.workunit.client.0.trial148.stdout: "target_max_bytes": 0, 2026-02-17T11:17:49.450 INFO:tasks.workunit.client.0.trial148.stdout: "target_max_objects": 0, 2026-02-17T11:17:49.450 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T11:17:49.450 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T11:17:49.450 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T11:17:49.450 INFO:tasks.workunit.client.0.trial148.stdout: "cache_min_flush_age": 0, 2026-02-17T11:17:49.450 INFO:tasks.workunit.client.0.trial148.stdout: "cache_min_evict_age": 0, 2026-02-17T11:17:49.450 INFO:tasks.workunit.client.0.trial148.stdout: "erasure_code_profile": "", 2026-02-17T11:17:49.450 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_params": { 2026-02-17T11:17:49.450 INFO:tasks.workunit.client.0.trial148.stdout: "type": "none" 2026-02-17T11:17:49.450 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.451 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_period": 0, 2026-02-17T11:17:49.451 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_count": 0, 2026-02-17T11:17:49.451 INFO:tasks.workunit.client.0.trial148.stdout: "use_gmt_hitset": true, 2026-02-17T11:17:49.451 INFO:tasks.workunit.client.0.trial148.stdout: "min_read_recency_for_promote": 0, 2026-02-17T11:17:49.451 INFO:tasks.workunit.client.0.trial148.stdout: "min_write_recency_for_promote": 0, 2026-02-17T11:17:49.451 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T11:17:49.451 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_search_last_n": 0, 2026-02-17T11:17:49.451 INFO:tasks.workunit.client.0.trial148.stdout: "grade_table": [], 2026-02-17T11:17:49.451 INFO:tasks.workunit.client.0.trial148.stdout: "stripe_width": 0, 2026-02-17T11:17:49.451 INFO:tasks.workunit.client.0.trial148.stdout: "expected_num_objects": 0, 2026-02-17T11:17:49.451 INFO:tasks.workunit.client.0.trial148.stdout: "fast_read": false, 2026-02-17T11:17:49.451 INFO:tasks.workunit.client.0.trial148.stdout: "options": {}, 2026-02-17T11:17:49.451 INFO:tasks.workunit.client.0.trial148.stdout: "application_metadata": {}, 2026-02-17T11:17:49.452 INFO:tasks.workunit.client.0.trial148.stdout: "read_balance": { 2026-02-17T11:17:49.452 INFO:tasks.workunit.client.0.trial148.stdout: "score_type": "Fair distribution", 2026-02-17T11:17:49.452 INFO:tasks.workunit.client.0.trial148.stdout: "score_acting": 2.9900000095367432, 2026-02-17T11:17:49.452 INFO:tasks.workunit.client.0.trial148.stdout: "score_stable": 2.9900000095367432, 2026-02-17T11:17:49.452 INFO:tasks.workunit.client.0.trial148.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T11:17:49.452 INFO:tasks.workunit.client.0.trial148.stdout: "raw_score_acting": 2, 2026-02-17T11:17:49.452 INFO:tasks.workunit.client.0.trial148.stdout: "raw_score_stable": 2, 2026-02-17T11:17:49.452 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity_weighted": 1, 2026-02-17T11:17:49.452 INFO:tasks.workunit.client.0.trial148.stdout: "average_primary_affinity": 1, 2026-02-17T11:17:49.452 INFO:tasks.workunit.client.0.trial148.stdout: "average_primary_affinity_weighted": 1 2026-02-17T11:17:49.452 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.453 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.453 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:17:49.453 INFO:tasks.workunit.client.0.trial148.stdout: "osds": [ 2026-02-17T11:17:49.453 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.453 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:17:49.453 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "c8aaf815-94b1-4949-96b2-b16a33de34d1", 2026-02-17T11:17:49.453 INFO:tasks.workunit.client.0.trial148.stdout: "up": 1, 2026-02-17T11:17:49.453 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:17:49.453 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:17:49.453 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:17:49.453 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 5, 2026-02-17T11:17:49.453 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 26, 2026-02-17T11:17:49.454 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 33, 2026-02-17T11:17:49.454 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 39, 2026-02-17T11:17:49.454 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 27, 2026-02-17T11:17:49.454 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:17:49.454 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:17:49.454 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:17:49.454 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.454 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:17:49.454 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6802", 2026-02-17T11:17:49.454 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2678757997 2026-02-17T11:17:49.454 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.454 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.455 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:17:49.455 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6803", 2026-02-17T11:17:49.455 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2678757997 2026-02-17T11:17:49.455 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.455 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.455 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.455 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:17:49.455 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:17:49.455 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.455 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:17:49.455 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6804", 2026-02-17T11:17:49.456 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2678757997 2026-02-17T11:17:49.456 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.456 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.456 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:17:49.456 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6805", 2026-02-17T11:17:49.456 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2678757997 2026-02-17T11:17:49.456 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.456 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.456 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.456 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:17:49.456 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:17:49.457 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.457 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:17:49.457 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6808", 2026-02-17T11:17:49.457 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2678757997 2026-02-17T11:17:49.457 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.457 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.457 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:17:49.457 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6809", 2026-02-17T11:17:49.457 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2678757997 2026-02-17T11:17:49.457 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.457 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.458 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.458 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:17:49.458 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:17:49.458 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.458 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:17:49.458 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6806", 2026-02-17T11:17:49.458 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2678757997 2026-02-17T11:17:49.458 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.458 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.458 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:17:49.458 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6807", 2026-02-17T11:17:49.458 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2678757997 2026-02-17T11:17:49.458 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.459 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.459 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.459 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6803/2678757997", 2026-02-17T11:17:49.459 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6805/2678757997", 2026-02-17T11:17:49.459 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6809/2678757997", 2026-02-17T11:17:49.459 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6807/2678757997", 2026-02-17T11:17:49.459 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:17:49.459 INFO:tasks.workunit.client.0.trial148.stdout: "exists", 2026-02-17T11:17:49.459 INFO:tasks.workunit.client.0.trial148.stdout: "up" 2026-02-17T11:17:49.459 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.459 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.459 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.460 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:17:49.460 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "ed659628-1e35-4975-9a8a-0acf011e4716", 2026-02-17T11:17:49.460 INFO:tasks.workunit.client.0.trial148.stdout: "up": 0, 2026-02-17T11:17:49.460 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:17:49.460 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:17:49.460 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:17:49.460 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 0, 2026-02-17T11:17:49.460 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 0, 2026-02-17T11:17:49.460 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 9, 2026-02-17T11:17:49.460 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 21, 2026-02-17T11:17:49.461 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 28, 2026-02-17T11:17:49.461 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:17:49.461 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:17:49.461 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:17:49.461 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.461 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:17:49.461 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6810", 2026-02-17T11:17:49.461 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3055380953 2026-02-17T11:17:49.461 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.461 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.461 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:17:49.461 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6811", 2026-02-17T11:17:49.461 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3055380953 2026-02-17T11:17:49.462 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.462 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.462 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.462 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:17:49.462 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:17:49.462 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.462 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:17:49.462 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6812", 2026-02-17T11:17:49.462 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3055380953 2026-02-17T11:17:49.462 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.462 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.462 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:17:49.463 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6813", 2026-02-17T11:17:49.463 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3055380953 2026-02-17T11:17:49.463 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.463 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.463 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.463 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:17:49.463 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:17:49.463 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.463 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:17:49.463 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6816", 2026-02-17T11:17:49.463 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3055380953 2026-02-17T11:17:49.463 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.463 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.464 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:17:49.464 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6817", 2026-02-17T11:17:49.464 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3055380953 2026-02-17T11:17:49.464 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.464 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.464 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.464 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:17:49.464 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:17:49.464 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.464 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:17:49.464 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6814", 2026-02-17T11:17:49.464 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3055380953 2026-02-17T11:17:49.464 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.465 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.465 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:17:49.465 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6815", 2026-02-17T11:17:49.465 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3055380953 2026-02-17T11:17:49.465 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.465 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.465 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.465 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6811/3055380953", 2026-02-17T11:17:49.465 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6813/3055380953", 2026-02-17T11:17:49.465 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3055380953", 2026-02-17T11:17:49.465 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3055380953", 2026-02-17T11:17:49.465 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:17:49.466 INFO:tasks.workunit.client.0.trial148.stdout: "exists" 2026-02-17T11:17:49.466 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.466 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.466 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.466 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:17:49.466 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "444f54f7-411d-409e-9057-71f2cbbc5258", 2026-02-17T11:17:49.466 INFO:tasks.workunit.client.0.trial148.stdout: "up": 1, 2026-02-17T11:17:49.466 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:17:49.466 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:17:49.466 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:17:49.466 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 14, 2026-02-17T11:17:49.466 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 26, 2026-02-17T11:17:49.466 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 36, 2026-02-17T11:17:49.467 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 0, 2026-02-17T11:17:49.467 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 29, 2026-02-17T11:17:49.467 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:17:49.467 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:17:49.467 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:17:49.467 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.467 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:17:49.467 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6810", 2026-02-17T11:17:49.467 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 494313416 2026-02-17T11:17:49.467 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.467 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.467 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:17:49.467 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6811", 2026-02-17T11:17:49.467 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 494313416 2026-02-17T11:17:49.468 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.468 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.468 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.468 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:17:49.468 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:17:49.468 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.468 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:17:49.468 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6812", 2026-02-17T11:17:49.468 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 494313416 2026-02-17T11:17:49.468 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.468 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.468 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:17:49.469 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6813", 2026-02-17T11:17:49.469 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 494313416 2026-02-17T11:17:49.469 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.469 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.469 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.469 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:17:49.469 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:17:49.469 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.469 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:17:49.469 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6816", 2026-02-17T11:17:49.469 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 494313416 2026-02-17T11:17:49.469 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.469 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.469 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:17:49.470 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6817", 2026-02-17T11:17:49.470 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 494313416 2026-02-17T11:17:49.470 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.470 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.470 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.470 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:17:49.470 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:17:49.470 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.470 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:17:49.470 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6814", 2026-02-17T11:17:49.470 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 494313416 2026-02-17T11:17:49.471 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.471 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.471 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:17:49.471 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6815", 2026-02-17T11:17:49.471 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 494313416 2026-02-17T11:17:49.471 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.471 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.471 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.471 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6811/494313416", 2026-02-17T11:17:49.471 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6813/494313416", 2026-02-17T11:17:49.471 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6817/494313416", 2026-02-17T11:17:49.471 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6815/494313416", 2026-02-17T11:17:49.471 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:17:49.472 INFO:tasks.workunit.client.0.trial148.stdout: "exists", 2026-02-17T11:17:49.472 INFO:tasks.workunit.client.0.trial148.stdout: "up" 2026-02-17T11:17:49.472 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.472 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.472 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:17:49.472 INFO:tasks.workunit.client.0.trial148.stdout: "osd_xinfo": [ 2026-02-17T11:17:49.472 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.472 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:17:49.472 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:17:06.724023+0000", 2026-02-17T11:17:49.472 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:17:49.472 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:17:49.472 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:17:49.472 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:17:49.472 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "2026-02-17T11:16:22.263125+0000", 2026-02-17T11:17:49.473 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:17:49.473 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.473 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.473 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:17:49.473 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:17:06.995684+0000", 2026-02-17T11:17:49.473 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:17:49.473 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:17:49.473 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:17:49.473 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:17:49.473 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "2026-02-17T11:16:31.484363+0000", 2026-02-17T11:17:49.473 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:17:49.473 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.473 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.473 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:17:49.473 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:17:07.299499+0000", 2026-02-17T11:17:49.474 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:17:49.474 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:17:49.474 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:17:49.474 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:17:49.474 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "2026-02-17T11:16:40.672288+0000", 2026-02-17T11:17:49.474 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:17:49.474 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.474 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:17:49.474 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap": [], 2026-02-17T11:17:49.474 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap_items": [], 2026-02-17T11:17:49.474 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap_primaries": [], 2026-02-17T11:17:49.474 INFO:tasks.workunit.client.0.trial148.stdout: "pg_temp": [], 2026-02-17T11:17:49.474 INFO:tasks.workunit.client.0.trial148.stdout: "primary_temp": [], 2026-02-17T11:17:49.474 INFO:tasks.workunit.client.0.trial148.stdout: "blocklist": {}, 2026-02-17T11:17:49.475 INFO:tasks.workunit.client.0.trial148.stdout: "range_blocklist": {}, 2026-02-17T11:17:49.475 INFO:tasks.workunit.client.0.trial148.stdout: "erasure_code_profiles": { 2026-02-17T11:17:49.475 INFO:tasks.workunit.client.0.trial148.stdout: "default": { 2026-02-17T11:17:49.475 INFO:tasks.workunit.client.0.trial148.stdout: "k": "2", 2026-02-17T11:17:49.475 INFO:tasks.workunit.client.0.trial148.stdout: "m": "2", 2026-02-17T11:17:49.475 INFO:tasks.workunit.client.0.trial148.stdout: "plugin": "jerasure", 2026-02-17T11:17:49.475 INFO:tasks.workunit.client.0.trial148.stdout: "technique": "reed_sol_van" 2026-02-17T11:17:49.475 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.475 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.475 INFO:tasks.workunit.client.0.trial148.stdout: "removed_snaps_queue": [], 2026-02-17T11:17:49.475 INFO:tasks.workunit.client.0.trial148.stdout: "new_removed_snaps": [], 2026-02-17T11:17:49.475 INFO:tasks.workunit.client.0.trial148.stdout: "new_purged_snaps": [], 2026-02-17T11:17:49.475 INFO:tasks.workunit.client.0.trial148.stdout: "crush_node_flags": {}, 2026-02-17T11:17:49.475 INFO:tasks.workunit.client.0.trial148.stdout: "device_class_flags": {}, 2026-02-17T11:17:49.475 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode": { 2026-02-17T11:17:49.476 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode_enabled": false, 2026-02-17T11:17:49.476 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_bucket_count": 0, 2026-02-17T11:17:49.476 INFO:tasks.workunit.client.0.trial148.stdout: "degraded_stretch_mode": 0, 2026-02-17T11:17:49.476 INFO:tasks.workunit.client.0.trial148.stdout: "recovering_stretch_mode": 0, 2026-02-17T11:17:49.476 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode_bucket": 0 2026-02-17T11:17:49.476 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.476 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.476 INFO:tasks.workunit.client.0.trial148.stdout: "osd_metadata": [ 2026-02-17T11:17:49.476 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.476 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:17:49.476 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:17:49.476 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6804/2678757997,v1:127.0.0.1:6805/2678757997]", 2026-02-17T11:17:49.476 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:17:49.476 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:17:49.476 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:17:49.477 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:17:49.477 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:17:49.477 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:17:49.477 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:17:49.477 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:17:49.477 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:17:49.477 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:17:49.477 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:17:49.477 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:17:49.477 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T11:17:49.477 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:17:49.477 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:17:49.477 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:17:49.477 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:17:49.477 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:17:49.477 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:17:49.477 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:17:49.478 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:17:49.478 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:17:49.478 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:17:49.478 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:16:15.679954Z", 2026-02-17T11:17:49.478 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:17:49.478 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:17:49.478 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:17:49.478 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:17:49.478 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:17:49.478 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:17:49.478 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:17:49.478 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6802/2678757997,v1:127.0.0.1:6803/2678757997]", 2026-02-17T11:17:49.478 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:17:49.478 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/2678757997,v1:127.0.0.1:6809/2678757997]", 2026-02-17T11:17:49.478 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/2678757997,v1:127.0.0.1:6807/2678757997]", 2026-02-17T11:17:49.478 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:17:49.478 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:17:49.479 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:17:49.479 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:17:49.479 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:17:49.479 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:17:49.479 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:17:49.479 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:17:49.479 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:17:49.479 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:17:49.479 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T11:17:49.479 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:17:49.479 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:17:49.479 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:17:49.479 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.479 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.479 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:17:49.479 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:17:49.479 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6812/3055380953,v1:127.0.0.1:6813/3055380953]", 2026-02-17T11:17:49.480 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:17:49.480 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:17:49.480 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:17:49.480 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:17:49.480 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:17:49.480 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:17:49.480 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:17:49.480 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:17:49.480 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:17:49.480 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:17:49.480 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:17:49.480 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:17:49.480 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T11:17:49.480 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:17:49.480 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:17:49.480 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:17:49.480 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:17:49.481 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:17:49.481 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:17:49.481 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:17:49.481 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:17:49.481 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:17:49.481 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:17:49.481 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:16:24.903522Z", 2026-02-17T11:17:49.481 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:17:49.481 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:17:49.481 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:17:49.481 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:17:49.481 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:17:49.481 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:17:49.482 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:17:49.482 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6810/3055380953,v1:127.0.0.1:6811/3055380953]", 2026-02-17T11:17:49.482 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:17:49.482 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3055380953,v1:127.0.0.1:6817/3055380953]", 2026-02-17T11:17:49.482 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3055380953,v1:127.0.0.1:6815/3055380953]", 2026-02-17T11:17:49.482 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:17:49.482 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:17:49.482 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:17:49.482 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:17:49.482 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:17:49.482 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:17:49.482 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:17:49.482 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:17:49.482 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:17:49.482 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:17:49.482 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T11:17:49.482 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:17:49.482 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:17:49.482 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:17:49.483 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.483 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.483 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:17:49.483 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:17:49.483 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6812/494313416,v1:127.0.0.1:6813/494313416]", 2026-02-17T11:17:49.483 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:17:49.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:17:49.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:17:49.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:17:49.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:17:49.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:17:49.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:17:49.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:17:49.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:17:49.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:17:49.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:17:49.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:17:49.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T11:17:49.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:16:34.086447Z", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6810/494313416,v1:127.0.0.1:6811/494313416]", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:17:49.484 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/494313416,v1:127.0.0.1:6817/494313416]", 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/494313416,v1:127.0.0.1:6815/494313416]", 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_clean_epochs": { 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: "min_last_epoch_clean": 0, 2026-02-17T11:17:49.485 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_clean": { 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: "per_pool": [] 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: "osd_epochs": [ 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 33 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 37 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_first_committed": 1, 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_last_committed": 40, 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: "crushmap": { 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: "devices": [ 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.0", 2026-02-17T11:17:49.486 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.1", 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.2", 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: "types": [ 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 0, 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd" 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: "name": "host" 2026-02-17T11:17:49.487 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.488 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.488 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 2, 2026-02-17T11:17:49.488 INFO:tasks.workunit.client.0.trial148.stdout: "name": "chassis" 2026-02-17T11:17:49.488 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.488 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.488 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 3, 2026-02-17T11:17:49.488 INFO:tasks.workunit.client.0.trial148.stdout: "name": "rack" 2026-02-17T11:17:49.488 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.488 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.488 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 4, 2026-02-17T11:17:49.488 INFO:tasks.workunit.client.0.trial148.stdout: "name": "row" 2026-02-17T11:17:49.488 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.488 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.488 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 5, 2026-02-17T11:17:49.488 INFO:tasks.workunit.client.0.trial148.stdout: "name": "pdu" 2026-02-17T11:17:49.488 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.488 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.488 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 6, 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: "name": "pod" 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 7, 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: "name": "room" 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 8, 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: "name": "datacenter" 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 9, 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: "name": "zone" 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 10, 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: "name": "region" 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:17:49.489 INFO:tasks.workunit.client.0.trial148.stdout: "name": "root" 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: "buckets": [ 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: "id": -1, 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: "name": "default", 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "root", 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: "id": -3, 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: "id": -2, 2026-02-17T11:17:49.490 INFO:tasks.workunit.client.0.trial148.stdout: "name": "default~ssd", 2026-02-17T11:17:49.491 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:17:49.491 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "root", 2026-02-17T11:17:49.491 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:17:49.491 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:17:49.491 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:17:49.491 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:17:49.491 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.491 INFO:tasks.workunit.client.0.trial148.stdout: "id": -4, 2026-02-17T11:17:49.491 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:17:49.491 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:17:49.491 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.491 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.491 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.491 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.491 INFO:tasks.workunit.client.0.trial148.stdout: "id": -3, 2026-02-17T11:17:49.491 INFO:tasks.workunit.client.0.trial148.stdout: "name": "trial148", 2026-02-17T11:17:49.491 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:17:49.491 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "host", 2026-02-17T11:17:49.491 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 1 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 2 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: "id": -4, 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: "name": "trial148~ssd", 2026-02-17T11:17:49.492 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "host", 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 1 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 2 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: "rules": [ 2026-02-17T11:17:49.493 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: "rule_id": 0, 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: "rule_name": "replicated_rule", 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: "type": 1, 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: "steps": [ 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: "op": "take", 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: "item": -1, 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: "item_name": "default" 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: "op": "choose_firstn", 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: "num": 0, 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: "type": "osd" 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: "op": "emit" 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: "tunables": { 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: "choose_local_tries": 0, 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: "choose_local_fallback_tries": 0, 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: "choose_total_tries": 50, 2026-02-17T11:17:49.494 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_descend_once": 1, 2026-02-17T11:17:49.495 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_vary_r": 1, 2026-02-17T11:17:49.495 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_stable": 1, 2026-02-17T11:17:49.495 INFO:tasks.workunit.client.0.trial148.stdout: "msr_descents": 100, 2026-02-17T11:17:49.495 INFO:tasks.workunit.client.0.trial148.stdout: "msr_collision_tries": 100, 2026-02-17T11:17:49.495 INFO:tasks.workunit.client.0.trial148.stdout: "straw_calc_version": 1, 2026-02-17T11:17:49.495 INFO:tasks.workunit.client.0.trial148.stdout: "allowed_bucket_algs": 54, 2026-02-17T11:17:49.495 INFO:tasks.workunit.client.0.trial148.stdout: "profile": "jewel", 2026-02-17T11:17:49.495 INFO:tasks.workunit.client.0.trial148.stdout: "optimal_tunables": 1, 2026-02-17T11:17:49.495 INFO:tasks.workunit.client.0.trial148.stdout: "legacy_tunables": 0, 2026-02-17T11:17:49.495 INFO:tasks.workunit.client.0.trial148.stdout: "minimum_required_version": "jewel", 2026-02-17T11:17:49.495 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables": 1, 2026-02-17T11:17:49.495 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables2": 1, 2026-02-17T11:17:49.495 INFO:tasks.workunit.client.0.trial148.stdout: "has_v2_rules": 0, 2026-02-17T11:17:49.495 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables3": 1, 2026-02-17T11:17:49.495 INFO:tasks.workunit.client.0.trial148.stdout: "has_v3_rules": 0, 2026-02-17T11:17:49.495 INFO:tasks.workunit.client.0.trial148.stdout: "has_v4_buckets": 1, 2026-02-17T11:17:49.495 INFO:tasks.workunit.client.0.trial148.stderr:report 324071107 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables5": 1, 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: "has_v5_rules": 0, 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: "has_msr_rules": 0 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: "choose_args": {} 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: "fsmap": { 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 1, 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: "btime": "2026-02-17T11:16:12:975312+0000", 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: "default_fscid": -1, 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: "compat": { 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: "compat": {}, 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: "ro_compat": {}, 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: "incompat": { 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: "feature_1": "base v0.20", 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: "feature_2": "client writeable ranges", 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: "feature_4": "dir inode in separate object", 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T11:17:49.496 INFO:tasks.workunit.client.0.trial148.stdout: "feature_8": "no anchor table", 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "feature_9": "file layout v2", 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "feature_10": "snaprealm v2", 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "feature_11": "minor log segments", 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "feature_flags": { 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "enable_multiple": true, 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "ever_enabled_multiple": true 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "standbys": [], 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "filesystems": [] 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "mdsmap_first_committed": 1, 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "mdsmap_last_committed": 1, 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "auth": { 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "first_committed": 1, 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "last_committed": 5, 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "num_secrets": 3 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg": 1, 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_active": 1, 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_unknown": 0, 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "num_osd": 3, 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "pool_sum": { 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "stat_sum": { 2026-02-17T11:17:49.497 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes": 69500, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects": 100, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_clones": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_copies": 300, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_degraded": 100, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_misplaced": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_unfound": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_dirty": 100, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_whiteouts": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_read": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_read_kb": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_write": 100, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_write_kb": 100, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_scrub_errors": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_deep_scrub_errors": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_recovered": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_recovered": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_keys_recovered": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_omap": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_kb": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_kb": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_promote": 0, 2026-02-17T11:17:49.498 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_high": 0, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_low": 0, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_some": 0, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_full": 0, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_pinned": 0, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "num_legacy_snapsets": 0, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "num_large_omap_objects": 0, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_manifest": 0, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_bytes": 0, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_keys": 0, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_repaired": 0 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "store_stats": { 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "total": 0, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "available": 0, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 0, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 0, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 0, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 0 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "log_size": 16, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "ondisk_log_size": 16, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "up": 2, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "acting": 2, 2026-02-17T11:17:49.499 INFO:tasks.workunit.client.0.trial148.stdout: "num_store_stats": 0 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "osd_sum": { 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 0, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 0, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "num_pgs": 3, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "num_osds": 3, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_osds": 3, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "kb": 314572800, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used": 83880, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_data": 2064, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_omap": 10, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_meta": 81717, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "kb_avail": 314488920, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "statfs": { 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "total": 322122547200, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "available": 322036654080, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 2113536, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 472458, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 10383, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 83679089 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "hb_peers": [], 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "snap_trim_queue_len": 0, 2026-02-17T11:17:49.500 INFO:tasks.workunit.client.0.trial148.stdout: "num_snap_trimming": 0, 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "num_shards_repaired": 0, 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "op_queue_age_hist": { 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "histogram": [], 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "upper_bound": 1 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "perf_stat": { 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ms": 0, 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ms": 0, 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ns": 0, 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ns": 0 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "alerts": [], 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "network_ping_times": [] 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "osd_sum_by_class": { 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "ssd": { 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 0, 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 0, 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "num_pgs": 3, 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "num_osds": 3, 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_osds": 3, 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "kb": 314572800, 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used": 83880, 2026-02-17T11:17:49.501 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_data": 2064, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_omap": 10, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_meta": 81717, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "kb_avail": 314488920, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "statfs": { 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "total": 322122547200, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "available": 322036654080, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 2113536, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 472458, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 10383, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 83679089 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "hb_peers": [], 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "snap_trim_queue_len": 0, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_snap_trimming": 0, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_shards_repaired": 0, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "op_queue_age_hist": { 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "histogram": [], 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "upper_bound": 1 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "perf_stat": { 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ms": 0, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ms": 0, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ns": 0, 2026-02-17T11:17:49.502 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ns": 0 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "alerts": [], 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "network_ping_times": [] 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "pool_stats": [ 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "poolid": 1, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg": 1, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "stat_sum": { 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes": 69500, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects": 100, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_clones": 0, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_copies": 300, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing": 0, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_degraded": 100, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_misplaced": 0, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_unfound": 0, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_dirty": 100, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_whiteouts": 0, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_read": 0, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_read_kb": 0, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_write": 100, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_write_kb": 100, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_scrub_errors": 0, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_deep_scrub_errors": 0, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_recovered": 0, 2026-02-17T11:17:49.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_recovered": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_keys_recovered": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_omap": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_kb": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_kb": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_promote": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_high": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_low": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_some": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_full": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_pinned": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_legacy_snapsets": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_large_omap_objects": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_manifest": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_bytes": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_keys": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_repaired": 0 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "store_stats": { 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "total": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "available": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 1220608, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 207654, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:17:49.504 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 0, 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 0 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: "log_size": 16, 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: "ondisk_log_size": 16, 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: "up": 2, 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: "acting": 2, 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: "num_store_stats": 3 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: "osd_stats": [ 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 141733920777 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 38654705677 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 154618822664 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_by_state": [ 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: "state": "active+undersized+degraded", 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: "num": 1 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.505 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_by_osd": [ 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 0, 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 1, 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 1, 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 1, 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 0, 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 0, 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snaps": [ 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "pool": 1, 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snaps": {} 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "servicemap": { 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 4, 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:17:33.415809+0000", 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "services": { 2026-02-17T11:17:49.506 INFO:tasks.workunit.client.0.trial148.stdout: "osd": { 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "daemons": { 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "summary": "", 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "0": { 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "start_epoch": 0, 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "start_stamp": "0.000000", 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "gid": 0, 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "metadata": {}, 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "task_status": {} 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "2": { 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "start_epoch": 0, 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "start_stamp": "0.000000", 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "gid": 0, 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "metadata": {}, 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "task_status": {} 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "mgrstat_first_committed": 1, 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "mgrstat_last_committed": 45, 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "logm_first_committed": 1, 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "logm_last_committed": 237, 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "paxos": { 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "first_committed": 1, 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "last_committed": 333, 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "last_pn": 0, 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: "accepted_pn": 0 2026-02-17T11:17:49.507 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:17:49.508 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:17:49.508 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1680: wait_for_clean: return 1 2026-02-17T11:17:49.508 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:528: TEST_divergent_2: expr 2 + 2 2026-02-17T11:17:49.508 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:528: TEST_divergent_2: objname=existing_4 2026-02-17T11:17:49.508 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: echo 'writing non-divergent object existing_4' 2026-02-17T11:17:49.508 INFO:tasks.workunit.client.0.trial148.stdout:writing non-divergent object existing_4 2026-02-17T11:17:49.508 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:530: TEST_divergent_2: ceph pg dump pgs 2026-02-17T11:17:49.632 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:17:49.633 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 100 0 0 69500 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:17:19.245598+0000 26'100 40:128 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:16:42.441928+0000 0'0 2026-02-17T11:16:42.441928+0000 0 0 periodic scrub scheduled @ 2026-02-18T13:55:36.229528+0000 0 0 2026-02-17T11:17:49.633 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:17:49.633 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:17:49.633 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:17:49.641 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:531: TEST_divergent_2: rados -p test put existing_4 /etc/resolv.conf 2026-02-17T11:17:49.672 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:533: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T11:17:49.672 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:533: TEST_divergent_2: wait_for_clean 2026-02-17T11:17:49.672 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T11:17:49.672 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T11:17:49.672 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T11:17:49.672 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T11:17:49.673 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T11:17:49.673 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T11:17:49.673 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T11:17:49.673 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T11:17:49.673 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T11:17:49.745 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T11:17:49.745 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T11:17:49.746 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T11:17:49.746 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T11:17:49.746 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:17:49.746 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:17:49.952 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:17:49.952 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:17:49.953 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:17:49.953 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:17:49.953 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:17:49.953 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:17:50.031 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=141733920780 2026-02-17T11:17:50.031 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 141733920780 2026-02-17T11:17:50.031 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-141733920780' 2026-02-17T11:17:50.031 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:17:50.031 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:17:50.094 INFO:tasks.workunit.client.0.trial148.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-17T11:17:50.096 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq= 2026-02-17T11:17:50.096 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z '' 2026-02-17T11:17:50.096 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: continue 2026-02-17T11:17:50.096 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:17:50.096 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:17:50.176 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=154618822667 2026-02-17T11:17:50.176 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 154618822667 2026-02-17T11:17:50.176 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-141733920780 2-154618822667' 2026-02-17T11:17:50.176 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:17:50.177 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-141733920780 2026-02-17T11:17:50.177 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:17:50.178 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:17:50.179 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-141733920780 2026-02-17T11:17:50.179 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:17:50.180 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=141733920780 2026-02-17T11:17:50.180 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 141733920780 2026-02-17T11:17:50.180 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 141733920780' 2026-02-17T11:17:50.180 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:17:50.388 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 141733920778 -lt 141733920780 2026-02-17T11:17:50.388 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:17:51.389 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:17:51.390 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:17:51.596 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 141733920780 -lt 141733920780 2026-02-17T11:17:51.596 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:17:51.597 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-154618822667 2026-02-17T11:17:51.597 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:17:51.598 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:17:51.599 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-154618822667 2026-02-17T11:17:51.599 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:17:51.600 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=154618822667 2026-02-17T11:17:51.600 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 154618822667 2026-02-17T11:17:51.600 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 154618822667' 2026-02-17T11:17:51.601 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:17:51.808 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 154618822667 -lt 154618822667 2026-02-17T11:17:51.809 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T11:17:51.809 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:17:51.809 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:17:52.072 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 == 0 2026-02-17T11:17:52.072 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:17:52.072 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:17:52.073 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:17:52.073 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:17:52.073 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:17:52.073 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:17:52.073 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:17:52.266 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:17:52.266 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:17:52.267 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:17:52.267 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:17:52.523 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:17:52.524 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' -1 2026-02-17T11:17:52.524 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: loop=0 2026-02-17T11:17:52.524 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: num_active_clean=0 2026-02-17T11:17:52.524 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:17:52.524 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.1 2026-02-17T11:17:52.624 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:17:52.624 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:17:52.625 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:17:52.625 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:17:52.625 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:17:52.625 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:17:52.625 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:17:52.625 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:17:52.825 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:17:52.825 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:17:52.826 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:17:52.827 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:17:53.086 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:17:53.086 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:17:53.086 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:17:53.086 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:17:53.086 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:17:53.086 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:17:53.086 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:17:53.086 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:17:53.086 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:17:53.346 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:17:53.346 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:17:53.346 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 1 >= 8 )) 2026-02-17T11:17:53.346 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:17:53.346 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.2 2026-02-17T11:17:53.548 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:17:53.548 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:17:53.549 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:17:53.549 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:17:53.549 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:17:53.549 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:17:53.549 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:17:53.549 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:17:53.745 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:17:53.745 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:17:53.746 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:17:53.746 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:17:53.998 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:17:53.999 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:17:53.999 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:17:53.999 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:17:53.999 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:17:53.999 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:17:53.999 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:17:54.000 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:17:54.000 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:17:54.258 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:17:54.259 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:17:54.259 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 2 >= 8 )) 2026-02-17T11:17:54.259 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:17:54.259 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.4 2026-02-17T11:17:54.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:17:54.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:17:54.660 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:17:54.660 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:17:54.660 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:17:54.660 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:17:54.660 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:17:54.660 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:17:54.855 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:17:54.856 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:17:54.856 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:17:54.856 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:17:55.124 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:17:55.124 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:17:55.124 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:17:55.124 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:17:55.124 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:17:55.124 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:17:55.125 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:17:55.125 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:17:55.125 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:17:55.392 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:17:55.392 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:17:55.393 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 3 >= 8 )) 2026-02-17T11:17:55.393 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:17:55.393 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.8 2026-02-17T11:17:56.193 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:17:56.193 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:17:56.194 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:17:56.194 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:17:56.194 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:17:56.194 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:17:56.194 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:17:56.194 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:17:56.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:17:56.398 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:17:56.398 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:17:56.399 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:17:56.664 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:17:56.664 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:17:56.664 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:17:56.665 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:17:56.665 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:17:56.665 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:17:56.665 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:17:56.665 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:17:56.665 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:17:56.927 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:17:56.927 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:17:56.927 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 4 >= 8 )) 2026-02-17T11:17:56.927 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:17:56.927 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 1.6 2026-02-17T11:17:58.529 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:17:58.529 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:17:58.530 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:17:58.530 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:17:58.530 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:17:58.530 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:17:58.530 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:17:58.530 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:17:58.728 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:17:58.728 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:17:58.729 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:17:58.729 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:17:58.990 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:17:58.990 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:17:58.991 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:17:58.991 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:17:58.991 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:17:58.991 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:17:58.991 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:17:58.991 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:17:58.991 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:17:59.262 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:17:59.263 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:17:59.263 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 5 >= 8 )) 2026-02-17T11:17:59.263 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:17:59.263 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 3.2 2026-02-17T11:18:02.463 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:18:02.464 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:18:02.465 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:18:02.465 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:18:02.465 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:18:02.465 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:18:02.465 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:18:02.465 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:18:02.667 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:18:02.667 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:18:02.668 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:18:02.668 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:18:02.938 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:18:02.938 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:18:02.939 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:18:02.939 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:18:02.939 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:18:02.939 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:18:02.939 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:18:02.939 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:18:02.939 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:18:03.207 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:18:03.207 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:18:03.207 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 6 >= 8 )) 2026-02-17T11:18:03.207 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:18:03.207 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 6.4 2026-02-17T11:18:09.607 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:18:09.607 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:18:09.608 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:18:09.608 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:18:09.608 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:18:09.608 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:18:09.608 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:18:09.608 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:18:09.809 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:18:09.810 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:18:09.811 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:18:09.811 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:18:10.079 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:18:10.079 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:18:10.079 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:18:10.079 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:18:10.080 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:18:10.080 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:18:10.080 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:18:10.080 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:18:10.080 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:18:10.344 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:18:10.344 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:18:10.344 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 7 >= 8 )) 2026-02-17T11:18:10.344 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:18:10.344 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 7.3 2026-02-17T11:18:17.645 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:18:17.645 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:18:17.646 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:18:17.646 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:18:17.646 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:18:17.646 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:18:17.646 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:18:17.646 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:18:17.843 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:18:17.843 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:18:17.843 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:18:17.844 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:18:18.105 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:18:18.106 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:18:18.106 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:18:18.106 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:18:18.106 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:18:18.106 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:18:18.106 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:18:18.106 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:18:18.106 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:18:18.376 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:18:18.376 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:18:18.376 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 8 >= 8 )) 2026-02-17T11:18:18.377 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1679: wait_for_clean: ceph report 2026-02-17T11:18:18.628 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:18:18.628 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_fingerprint": "05a0446c-1c0a-4b8c-9835-09c9a32ebe5e", 2026-02-17T11:18:18.628 INFO:tasks.workunit.client.0.trial148.stdout: "version": "19.2.3-705-g04cf6dd4", 2026-02-17T11:18:18.628 INFO:tasks.workunit.client.0.trial148.stdout: "commit": "04cf6dd4be446d06026adad18a5fbf5da1fa8c0e", 2026-02-17T11:18:18.628 INFO:tasks.workunit.client.0.trial148.stdout: "timestamp": "2026-02-17T11:18:18.627945+0000", 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "tag": "", 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "health": { 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "status": "HEALTH_WARN", 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "checks": { 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "OSDMAP_FLAGS": { 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "count": 17 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [], 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "OSD_DOWN": { 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "message": "1 osds down", 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "count": 1 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "message": "osd.1 (root=default,host=trial148) is down" 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "PG_DEGRADED": { 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "count": 1 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "POOL_APP_NOT_ENABLED": { 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:18:18.629 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "message": "1 pool(s) do not have an application enabled", 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "count": 1 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "message": "application not enabled on pool 'test'" 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "message": "use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "mutes": [] 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "monmap_first_committed": 1, 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "monmap_last_committed": 1, 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "monmap": { 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 1, 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "fsid": "0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a", 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:16:12.896056Z", 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "created": "2026-02-17T11:16:12.896056Z", 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "min_mon_release": 19, 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "min_mon_release_name": "squid", 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "election_strategy": 1, 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "disallowed_leaders": "", 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode": false, 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "tiebreaker_mon": "", 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "removed_ranks": "", 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "features": { 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "persistent": [ 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "kraken", 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "luminous", 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "mimic", 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap-prune", 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "nautilus", 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "octopus", 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "pacific", 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "elector-pinging", 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "quincy", 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "reef", 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "squid" 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:18:18.630 INFO:tasks.workunit.client.0.trial148.stdout: "optional": [] 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "mons": [ 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "rank": 0, 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "name": "a", 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:7115", 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 0 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "priority": 0, 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 0, 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "crush_location": "{}" 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "quorum": [ 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: 0 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap": { 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 40, 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "fsid": "0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a", 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "created": "2026-02-17T11:16:12.975477+0000", 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:17:19.243060+0000", 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "last_up_change": "2026-02-17T11:17:18.096419+0000", 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "last_in_change": "2026-02-17T11:17:19.140812+0000", 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "flags_num": 5800384, 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "flags_set": [ 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "nodown", 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "noin", 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "noout", 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "pglog_hardlimit", 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snapdirs", 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "recovery_deletes", 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "sortbitwise" 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:18:18.631 INFO:tasks.workunit.client.0.trial148.stdout: "crush_version": 9, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_snapshot": "", 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "pool_max": 1, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "max_osd": 3, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "require_min_compat_client": "luminous", 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "min_compat_client": "jewel", 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "require_osd_release": "squid", 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "allow_crimson": false, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "pools": [ 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "pool": 1, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "pool_name": "test", 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "create_time": "2026-02-17T11:16:42.402898+0000", 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "flags": 1, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "flags_names": "hashpspool", 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "type": 1, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "size": 3, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "min_size": 2, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "crush_rule": 0, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_count": 0, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_target": 0, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "is_stretch_pool": false, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "object_hash": 2, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "pg_autoscale_mode": "off", 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num": 1, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "pg_placement_num": 1, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "pg_placement_num_target": 1, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num_target": 1, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num_pending": 1, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "last_pg_merge_meta": { 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "source_pgid": "0.0", 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "ready_epoch": 0, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_started": 0, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_clean": 0, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "source_version": "0'0", 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "target_version": "0'0" 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "last_change": "26", 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend": "0", 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T11:18:18.632 INFO:tasks.workunit.client.0.trial148.stdout: "auid": 0, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "snap_mode": "selfmanaged", 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "snap_seq": 0, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "snap_epoch": 0, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "pool_snaps": [], 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "removed_snaps": "[]", 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "quota_max_bytes": 0, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "quota_max_objects": 0, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "tiers": [], 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "tier_of": -1, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "read_tier": -1, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "write_tier": -1, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "cache_mode": "none", 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "target_max_bytes": 0, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "target_max_objects": 0, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "cache_min_flush_age": 0, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "cache_min_evict_age": 0, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "erasure_code_profile": "", 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_params": { 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "type": "none" 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_period": 0, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_count": 0, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "use_gmt_hitset": true, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "min_read_recency_for_promote": 0, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "min_write_recency_for_promote": 0, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_search_last_n": 0, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "grade_table": [], 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "stripe_width": 0, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "expected_num_objects": 0, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "fast_read": false, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "options": {}, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "application_metadata": {}, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "read_balance": { 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "score_type": "Fair distribution", 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "score_acting": 2.9900000095367432, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "score_stable": 2.9900000095367432, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "raw_score_acting": 2, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "raw_score_stable": 2, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity_weighted": 1, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "average_primary_affinity": 1, 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: "average_primary_affinity_weighted": 1 2026-02-17T11:18:18.633 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "osds": [ 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "c8aaf815-94b1-4949-96b2-b16a33de34d1", 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "up": 1, 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 5, 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 26, 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 33, 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 39, 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 27, 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6802", 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2678757997 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6803", 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2678757997 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6804", 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2678757997 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6805", 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2678757997 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.634 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6808", 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2678757997 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6809", 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2678757997 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6806", 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2678757997 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6807", 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2678757997 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6803/2678757997", 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6805/2678757997", 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6809/2678757997", 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6807/2678757997", 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "exists", 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "up" 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "ed659628-1e35-4975-9a8a-0acf011e4716", 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "up": 0, 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 0, 2026-02-17T11:18:18.635 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 0, 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 9, 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 21, 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 28, 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6810", 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3055380953 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6811", 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3055380953 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6812", 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3055380953 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6813", 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3055380953 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6816", 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3055380953 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6817", 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3055380953 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.636 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6814", 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3055380953 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6815", 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3055380953 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6811/3055380953", 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6813/3055380953", 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3055380953", 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3055380953", 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "exists" 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "444f54f7-411d-409e-9057-71f2cbbc5258", 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "up": 1, 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 14, 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 26, 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 36, 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 0, 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 29, 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6810", 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 494313416 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6811", 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 494313416 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.637 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6812", 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 494313416 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6813", 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 494313416 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6816", 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 494313416 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6817", 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 494313416 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6814", 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 494313416 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6815", 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 494313416 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6811/494313416", 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6813/494313416", 2026-02-17T11:18:18.638 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6817/494313416", 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6815/494313416", 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "exists", 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "up" 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "osd_xinfo": [ 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:17:06.724023+0000", 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "2026-02-17T11:16:22.263125+0000", 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:17:06.995684+0000", 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "2026-02-17T11:16:31.484363+0000", 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:17:07.299499+0000", 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "2026-02-17T11:16:40.672288+0000", 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap": [], 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap_items": [], 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap_primaries": [], 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "pg_temp": [], 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "primary_temp": [], 2026-02-17T11:18:18.639 INFO:tasks.workunit.client.0.trial148.stdout: "blocklist": {}, 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "range_blocklist": {}, 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "erasure_code_profiles": { 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "default": { 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "k": "2", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "m": "2", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "plugin": "jerasure", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "technique": "reed_sol_van" 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "removed_snaps_queue": [], 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "new_removed_snaps": [], 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "new_purged_snaps": [], 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "crush_node_flags": {}, 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "device_class_flags": {}, 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode": { 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode_enabled": false, 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_bucket_count": 0, 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "degraded_stretch_mode": 0, 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "recovering_stretch_mode": 0, 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode_bucket": 0 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "osd_metadata": [ 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6804/2678757997,v1:127.0.0.1:6805/2678757997]", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:18:18.640 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:16:15.679954Z", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6802/2678757997,v1:127.0.0.1:6803/2678757997]", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/2678757997,v1:127.0.0.1:6809/2678757997]", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/2678757997,v1:127.0.0.1:6807/2678757997]", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6812/3055380953,v1:127.0.0.1:6813/3055380953]", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:18:18.641 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:16:24.903522Z", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6810/3055380953,v1:127.0.0.1:6811/3055380953]", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3055380953,v1:127.0.0.1:6817/3055380953]", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3055380953,v1:127.0.0.1:6815/3055380953]", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6812/494313416,v1:127.0.0.1:6813/494313416]", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:18:18.642 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:16:34.086447Z", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6810/494313416,v1:127.0.0.1:6811/494313416]", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/494313416,v1:127.0.0.1:6817/494313416]", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/494313416,v1:127.0.0.1:6815/494313416]", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:18:18.643 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_clean_epochs": { 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "min_last_epoch_clean": 0, 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_clean": { 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "per_pool": [] 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "osd_epochs": [ 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 33 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 37 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_first_committed": 1, 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_last_committed": 40, 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "crushmap": { 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "devices": [ 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.0", 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.1", 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.2", 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "types": [ 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 0, 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd" 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:18:18.644 INFO:tasks.workunit.client.0.trial148.stdout: "name": "host" 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 2, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "name": "chassis" 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 3, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "name": "rack" 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 4, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "name": "row" 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 5, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "name": "pdu" 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 6, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "name": "pod" 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 7, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "name": "room" 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 8, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "name": "datacenter" 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 9, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "name": "zone" 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 10, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "name": "region" 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "name": "root" 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "buckets": [ 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "id": -1, 2026-02-17T11:18:18.645 INFO:tasks.workunit.client.0.trial148.stdout: "name": "default", 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "root", 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "id": -3, 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "id": -2, 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "name": "default~ssd", 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "root", 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "id": -4, 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "id": -3, 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "name": "trial148", 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "host", 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:18:18.646 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 1 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 2 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "id": -4, 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "name": "trial148~ssd", 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "host", 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 1 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 2 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "rules": [ 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "rule_id": 0, 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "rule_name": "replicated_rule", 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "type": 1, 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "steps": [ 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "op": "take", 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "item": -1, 2026-02-17T11:18:18.647 INFO:tasks.workunit.client.0.trial148.stdout: "item_name": "default" 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "op": "choose_firstn", 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "num": 0, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "type": "osd" 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "op": "emit" 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "tunables": { 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "choose_local_tries": 0, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "choose_local_fallback_tries": 0, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "choose_total_tries": 50, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_descend_once": 1, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_vary_r": 1, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_stable": 1, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "msr_descents": 100, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "msr_collision_tries": 100, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "straw_calc_version": 1, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "allowed_bucket_algs": 54, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "profile": "jewel", 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "optimal_tunables": 1, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "legacy_tunables": 0, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "minimum_required_version": "jewel", 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables": 1, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables2": 1, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "has_v2_rules": 0, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables3": 1, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "has_v3_rules": 0, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "has_v4_buckets": 1, 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stderr:report 2944783563 2026-02-17T11:18:18.648 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables5": 1, 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "has_v5_rules": 0, 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "has_msr_rules": 0 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "choose_args": {} 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "fsmap": { 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 1, 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "btime": "2026-02-17T11:16:12:975312+0000", 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "default_fscid": -1, 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "compat": { 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "compat": {}, 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "ro_compat": {}, 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "incompat": { 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "feature_1": "base v0.20", 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "feature_2": "client writeable ranges", 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "feature_4": "dir inode in separate object", 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "feature_8": "no anchor table", 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "feature_9": "file layout v2", 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "feature_10": "snaprealm v2", 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "feature_11": "minor log segments", 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "feature_flags": { 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "enable_multiple": true, 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "ever_enabled_multiple": true 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "standbys": [], 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "filesystems": [] 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "mdsmap_first_committed": 1, 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "mdsmap_last_committed": 1, 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "auth": { 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "first_committed": 1, 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "last_committed": 5, 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "num_secrets": 3 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg": 1, 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_active": 1, 2026-02-17T11:18:18.649 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_unknown": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_osd": 3, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "pool_sum": { 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "stat_sum": { 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes": 69772, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects": 100, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_clones": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_copies": 300, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_degraded": 100, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_misplaced": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_unfound": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_dirty": 100, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_whiteouts": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_read": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_read_kb": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_write": 101, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_write_kb": 101, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_scrub_errors": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_deep_scrub_errors": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_recovered": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_recovered": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_keys_recovered": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_omap": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_kb": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_kb": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_promote": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_high": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_low": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_some": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_full": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_pinned": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_legacy_snapsets": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_large_omap_objects": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_manifest": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_bytes": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_keys": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_repaired": 0 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "store_stats": { 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "total": 0, 2026-02-17T11:18:18.650 INFO:tasks.workunit.client.0.trial148.stdout: "available": 0, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 0, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 0, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 0, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 0 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "log_size": 17, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "ondisk_log_size": 17, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "up": 2, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "acting": 2, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "num_store_stats": 0 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "osd_sum": { 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 0, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 0, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "num_pgs": 3, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "num_osds": 3, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_osds": 3, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "kb": 314572800, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used": 83880, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_data": 2064, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_omap": 10, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_meta": 81717, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "kb_avail": 314488920, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "statfs": { 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "total": 322122547200, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "available": 322036654080, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 2113536, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 473002, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 10383, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 83679089 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "hb_peers": [], 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "snap_trim_queue_len": 0, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "num_snap_trimming": 0, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "num_shards_repaired": 0, 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "op_queue_age_hist": { 2026-02-17T11:18:18.651 INFO:tasks.workunit.client.0.trial148.stdout: "histogram": [], 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "upper_bound": 1 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "perf_stat": { 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ms": 0, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ms": 0, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ns": 0, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ns": 0 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "alerts": [], 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "network_ping_times": [] 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "osd_sum_by_class": { 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "ssd": { 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 0, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 0, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "num_pgs": 3, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "num_osds": 3, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_osds": 3, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "kb": 314572800, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used": 83880, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_data": 2064, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_omap": 10, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_meta": 81717, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "kb_avail": 314488920, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "statfs": { 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "total": 322122547200, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "available": 322036654080, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 2113536, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 473002, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 10383, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 83679089 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "hb_peers": [], 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "snap_trim_queue_len": 0, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "num_snap_trimming": 0, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "num_shards_repaired": 0, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "op_queue_age_hist": { 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "histogram": [], 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "upper_bound": 1 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.652 INFO:tasks.workunit.client.0.trial148.stdout: "perf_stat": { 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ms": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ms": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ns": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ns": 0 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "alerts": [], 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "network_ping_times": [] 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "pool_stats": [ 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "poolid": 1, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg": 1, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "stat_sum": { 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes": 69772, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects": 100, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_clones": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_copies": 300, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_degraded": 100, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_misplaced": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_unfound": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_dirty": 100, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_whiteouts": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_read": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_read_kb": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_write": 101, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_write_kb": 101, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_scrub_errors": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_deep_scrub_errors": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_recovered": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_recovered": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_keys_recovered": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_omap": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_kb": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_kb": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_promote": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_high": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_low": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_some": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_full": 0, 2026-02-17T11:18:18.653 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_pinned": 0, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "num_legacy_snapsets": 0, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "num_large_omap_objects": 0, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_manifest": 0, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_bytes": 0, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_keys": 0, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_repaired": 0 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "store_stats": { 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "total": 0, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "available": 0, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 1220608, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 208198, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 0, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 0 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "log_size": 17, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "ondisk_log_size": 17, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "up": 2, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "acting": 2, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "num_store_stats": 3 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "osd_stats": [ 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 141733920785 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 38654705677 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 154618822672 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_by_state": [ 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "state": "active+undersized+degraded", 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: "num": 1 2026-02-17T11:18:18.654 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_by_osd": [ 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 0, 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 1, 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 1, 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 1, 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 0, 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 0, 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snaps": [ 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "pool": 1, 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snaps": {} 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "servicemap": { 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 5, 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:18:15.420389+0000", 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "services": { 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "osd": { 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "daemons": { 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "summary": "", 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "2": { 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "start_epoch": 0, 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "start_stamp": "0.000000", 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "gid": 0, 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "metadata": {}, 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: "task_status": {} 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.655 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:18:18.656 INFO:tasks.workunit.client.0.trial148.stdout: "mgrstat_first_committed": 1, 2026-02-17T11:18:18.656 INFO:tasks.workunit.client.0.trial148.stdout: "mgrstat_last_committed": 60, 2026-02-17T11:18:18.656 INFO:tasks.workunit.client.0.trial148.stdout: "logm_first_committed": 1, 2026-02-17T11:18:18.656 INFO:tasks.workunit.client.0.trial148.stdout: "logm_last_committed": 295, 2026-02-17T11:18:18.656 INFO:tasks.workunit.client.0.trial148.stdout: "paxos": { 2026-02-17T11:18:18.656 INFO:tasks.workunit.client.0.trial148.stdout: "first_committed": 1, 2026-02-17T11:18:18.656 INFO:tasks.workunit.client.0.trial148.stdout: "last_committed": 406, 2026-02-17T11:18:18.656 INFO:tasks.workunit.client.0.trial148.stdout: "last_pn": 0, 2026-02-17T11:18:18.656 INFO:tasks.workunit.client.0.trial148.stdout: "accepted_pn": 0 2026-02-17T11:18:18.656 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:18:18.656 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:18:18.656 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1680: wait_for_clean: return 1 2026-02-17T11:18:18.656 INFO:tasks.workunit.client.0.trial148.stdout:delay recovery 2026-02-17T11:18:18.656 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:536: TEST_divergent_2: echo 'delay recovery' 2026-02-17T11:18:18.656 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:537: TEST_divergent_2: ceph pg dump pgs 2026-02-17T11:18:18.838 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:18:18.839 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 100 0 0 69772 0 0 17 84 17 active+undersized+degraded 2026-02-17T11:17:19.245598+0000 40'101 40:129 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:16:42.441928+0000 0'0 2026-02-17T11:16:42.441928+0000 0 0 periodic scrub scheduled @ 2026-02-18T13:55:36.229528+0000 0 0 2026-02-17T11:18:18.839 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:18:18.839 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:18:18.839 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:18:18.847 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:538: TEST_divergent_2: for i in $non_divergent 2026-02-17T11:18:18.848 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: get_asok_path osd.0 2026-02-17T11:18:18.848 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T11:18:18.848 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T11:18:18.848 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:18:18.848 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:18:18.848 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:18:18.849 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.0.asok 2026-02-17T11:18:18.849 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: CEPH_ARGS= 2026-02-17T11:18:18.849 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.0.asok set_recovery_delay 100000 2026-02-17T11:18:18.901 INFO:tasks.workunit.client.0.trial148.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T11:18:18.906 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:538: TEST_divergent_2: for i in $non_divergent 2026-02-17T11:18:18.907 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: get_asok_path osd.2 2026-02-17T11:18:18.907 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2026-02-17T11:18:18.907 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2026-02-17T11:18:18.907 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:18:18.908 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:18:18.908 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:18:18.908 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.2.asok 2026-02-17T11:18:18.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: CEPH_ARGS= 2026-02-17T11:18:18.909 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.2.asok set_recovery_delay 100000 2026-02-17T11:18:18.969 INFO:tasks.workunit.client.0.trial148.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T11:18:18.974 INFO:tasks.workunit.client.0.trial148.stdout:revive divergent 1 2026-02-17T11:18:18.975 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:544: TEST_divergent_2: echo 'revive divergent 1' 2026-02-17T11:18:18.975 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:545: TEST_divergent_2: ceph pg dump pgs 2026-02-17T11:18:19.169 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:18:19.169 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 100 0 0 69772 0 0 17 84 17 active+undersized+degraded 2026-02-17T11:17:19.245598+0000 40'101 40:129 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:16:42.441928+0000 0'0 2026-02-17T11:16:42.441928+0000 0 0 periodic scrub scheduled @ 2026-02-18T13:55:36.229528+0000 0 0 2026-02-17T11:18:19.169 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:18:19.170 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:18:19.170 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:18:19.177 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:546: TEST_divergent_2: ceph osd set noup 2026-02-17T11:18:19.447 INFO:tasks.workunit.client.0.trial148.stderr:noup is set 2026-02-17T11:18:19.460 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:547: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-17T11:18:19.460 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/divergent-priors 2026-02-17T11:18:19.460 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:18:19.460 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T11:18:19.460 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:18:19.460 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T11:18:19.460 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:18:19.461 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:18:19.461 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:18:19.461 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:18:19.461 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T11:18:19.461 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T11:18:19.461 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:18:19.461 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:18:19.461 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:18:19.461 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:18:19.461 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:18:19.462 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:18:19.462 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:18:19.462 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:18:19.462 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:18:19.462 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:18:19.462 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:18:19.462 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:18:19.463 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:18:19.463 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:18:19.463 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:18:19.463 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:18:19.463 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:18:19.463 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:18:19.464 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:18:19.464 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:18:19.464 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T11:18:19.464 INFO:tasks.workunit.client.0.trial148.stdout:start osd.1 2026-02-17T11:18:19.466 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T11:18:19.466 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:18:19.466 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T11:18:19.466 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T11:18:19.467 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:18:19.467 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:18:19.467 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:18:19.485 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:18:19.482+0000 7f6ebb7a48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:18:19.486 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:18:19.486+0000 7f6ebb7a48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:18:19.487 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:18:19.486+0000 7f6ebb7a48c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:18:19.669 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:880: activate_osd: return 0 2026-02-17T11:18:19.669 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:548: TEST_divergent_2: sleep 5 2026-02-17T11:18:20.480 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:18:20.478+0000 7f6ebb7a48c0 -1 Falling back to public interface 2026-02-17T11:18:23.470 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:18:23.466+0000 7f6ebb7a48c0 -1 osd.1 26 log_to_monitors true 2026-02-17T11:18:24.670 INFO:tasks.workunit.client.0.trial148.stdout:delay recovery divergent 2026-02-17T11:18:24.671 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:550: TEST_divergent_2: echo 'delay recovery divergent' 2026-02-17T11:18:24.671 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:551: TEST_divergent_2: ceph pg dump pgs 2026-02-17T11:18:24.859 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:18:24.859 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 100 0 0 69772 0 0 17 84 17 active+undersized+degraded 2026-02-17T11:17:19.245598+0000 40'101 42:132 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:16:42.441928+0000 0'0 2026-02-17T11:16:42.441928+0000 0 0 periodic scrub scheduled @ 2026-02-18T13:55:36.229528+0000 0 0 2026-02-17T11:18:24.860 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:18:24.860 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:18:24.860 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:18:24.868 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:552: TEST_divergent_2: get_asok_path osd.1 2026-02-17T11:18:24.868 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T11:18:24.868 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T11:18:24.869 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:18:24.869 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:18:24.869 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:18:24.869 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.1.asok 2026-02-17T11:18:24.869 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:552: TEST_divergent_2: CEPH_ARGS= 2026-02-17T11:18:24.869 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:552: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.1.asok set_recovery_delay 100000 2026-02-17T11:18:24.921 INFO:tasks.workunit.client.0.trial148.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T11:18:24.927 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: ceph osd unset noup 2026-02-17T11:18:25.240 INFO:tasks.workunit.client.0.trial148.stderr:noup is unset 2026-02-17T11:18:25.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:556: TEST_divergent_2: wait_for_osd up 0 2026-02-17T11:18:25.252 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:18:25.252 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T11:18:25.252 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:18:25.252 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:18:25.252 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:18:25.252 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:18:25.253 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:18:25.253 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:18:25.253 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:18:25.457 INFO:tasks.workunit.client.0.trial148.stdout:osd.0 up in weight 1 up_from 33 up_thru 39 down_at 27 last_clean_interval [5,26) [v2:127.0.0.1:6802/2678757997,v1:127.0.0.1:6803/2678757997] [v2:127.0.0.1:6804/2678757997,v1:127.0.0.1:6805/2678757997] exists,up c8aaf815-94b1-4949-96b2-b16a33de34d1 2026-02-17T11:18:25.458 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:18:25.458 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:18:25.458 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:18:25.458 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:557: TEST_divergent_2: wait_for_osd up 1 2026-02-17T11:18:25.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:18:25.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T11:18:25.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:18:25.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:18:25.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:18:25.459 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:18:25.460 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:18:25.460 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:18:25.460 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:18:25.658 INFO:tasks.workunit.client.0.trial148.stdout:osd.1 up in weight 1 up_from 45 up_thru 45 down_at 28 last_clean_interval [9,26) [v2:127.0.0.1:6818/2625496280,v1:127.0.0.1:6819/2625496280] [v2:127.0.0.1:6820/2625496280,v1:127.0.0.1:6821/2625496280] exists,up ed659628-1e35-4975-9a8a-0acf011e4716 2026-02-17T11:18:25.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:18:25.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:18:25.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:18:25.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:558: TEST_divergent_2: wait_for_osd up 2 2026-02-17T11:18:25.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:18:25.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T11:18:25.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:18:25.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:18:25.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:18:25.661 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:18:25.661 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:18:25.661 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:18:25.661 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:18:25.858 INFO:tasks.workunit.client.0.trial148.stdout:osd.2 up in weight 1 up_from 36 up_thru 0 down_at 29 last_clean_interval [14,26) [v2:127.0.0.1:6810/494313416,v1:127.0.0.1:6811/494313416] [v2:127.0.0.1:6812/494313416,v1:127.0.0.1:6813/494313416] exists,up 444f54f7-411d-409e-9057-71f2cbbc5258 2026-02-17T11:18:25.858 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:18:25.859 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:18:25.859 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:18:25.859 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:560: TEST_divergent_2: ceph pg dump pgs 2026-02-17T11:18:26.041 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:18:26.042 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 100 0 0 69772 0 0 17 84 17 active+undersized+degraded 2026-02-17T11:17:19.245598+0000 40'101 42:132 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:16:42.441928+0000 0'0 2026-02-17T11:16:42.441928+0000 0 0 periodic scrub scheduled @ 2026-02-18T13:55:36.229528+0000 0 0 2026-02-17T11:18:26.042 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:18:26.042 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:18:26.042 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:18:26.050 INFO:tasks.workunit.client.0.trial148.stdout:wait for peering 2026-02-17T11:18:26.050 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:561: TEST_divergent_2: echo 'wait for peering' 2026-02-17T11:18:26.050 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:562: TEST_divergent_2: ceph pg dump pgs 2026-02-17T11:18:26.239 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:18:26.239 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 100 0 0 69772 0 0 17 84 17 active+undersized+degraded 2026-02-17T11:17:19.245598+0000 40'101 42:132 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:16:42.441928+0000 0'0 2026-02-17T11:16:42.441928+0000 0 0 periodic scrub scheduled @ 2026-02-18T13:55:36.229528+0000 0 0 2026-02-17T11:18:26.240 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:18:26.240 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:18:26.240 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:18:26.247 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:563: TEST_divergent_2: rados -p test put foo /etc/fstab 2026-02-17T11:18:26.276 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:567: TEST_divergent_2: echo 'killing divergent 1' 2026-02-17T11:18:26.277 INFO:tasks.workunit.client.0.trial148.stdout:killing divergent 1 2026-02-17T11:18:26.277 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:568: TEST_divergent_2: ceph pg dump pgs 2026-02-17T11:18:26.464 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:18:26.464 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 100 0 0 69772 0 0 17 84 17 active+undersized+degraded 2026-02-17T11:17:19.245598+0000 40'101 42:132 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:16:42.441928+0000 0'0 2026-02-17T11:16:42.441928+0000 0 0 periodic scrub scheduled @ 2026-02-18T13:55:36.229528+0000 0 0 2026-02-17T11:18:26.464 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:18:26.464 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:18:26.465 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:18:26.472 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:569: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd.1 2026-02-17T11:18:26.473 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:18:26.473 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:18:26.473 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:18:26.473 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:18:26.473 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:18:26.581 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:18:26.581 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:572: TEST_divergent_2: expfile=td/divergent-priors/exp.19803.out 2026-02-17T11:18:26.581 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:573: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.19803.out 2026-02-17T11:18:26.581 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T11:18:26.581 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T11:18:26.581 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=1 2026-02-17T11:18:26.581 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T11:18:26.581 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T11:18:26.581 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.19803.out 2026-02-17T11:18:27.239 INFO:tasks.workunit.client.0.trial148.stderr:Exporting 1.0 info 1.0( v 46'102 lc 0'0 (26'90,46'102] local-lis/les=45/46 n=101 ec=21/21 lis/c=45/21 les/c/f=46/22/0 sis=45) 2026-02-17T11:18:27.245 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-17T11:18:27.245 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-17T11:18:27.245 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-17T11:18:27.245 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:091f9f1d:::existing_94:head# 2026-02-17T11:18:27.246 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:0a865a93:::existing_54:head# 2026-02-17T11:18:27.246 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:0fed513c:::existing_41:head# 2026-02-17T11:18:27.246 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:13b9e0b8:::existing_92:head# 2026-02-17T11:18:27.246 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:169157fa:::existing_81:head# 2026-02-17T11:18:27.246 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:17731382:::existing_58:head# 2026-02-17T11:18:27.246 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:18a45a39:::existing_43:head# 2026-02-17T11:18:27.246 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:1c160f01:::existing_66:head# 2026-02-17T11:18:27.246 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:1dd6c249:::existing_97:head# 2026-02-17T11:18:27.246 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:227e0c77:::existing_7:head# 2026-02-17T11:18:27.246 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:23e1b063:::existing_59:head# 2026-02-17T11:18:27.246 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:28566edb:::existing_78:head# 2026-02-17T11:18:27.246 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:2a101182:::existing_20:head# 2026-02-17T11:18:27.247 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:2d1519da:::existing_96:head# 2026-02-17T11:18:27.247 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:3078b87a:::existing_86:head# 2026-02-17T11:18:27.247 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:30bde01b:::existing_15:head# 2026-02-17T11:18:27.247 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:317a7e19:::existing_56:head# 2026-02-17T11:18:27.247 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:38b9c7fa:::existing_33:head# 2026-02-17T11:18:27.247 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:3e16d84b:::existing_48:head# 2026-02-17T11:18:27.247 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:45fe8203:::existing_75:head# 2026-02-17T11:18:27.247 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:4e82c9ba:::existing_50:head# 2026-02-17T11:18:27.247 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:5298dcdb:::existing_57:head# 2026-02-17T11:18:27.247 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:52ebaa44:::existing_32:head# 2026-02-17T11:18:27.247 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:53588912:::existing_9:head# 2026-02-17T11:18:27.247 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:5b7e2de6:::existing_84:head# 2026-02-17T11:18:27.247 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:5da0255c:::existing_13:head# 2026-02-17T11:18:27.247 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:5da2dab8:::existing_53:head# 2026-02-17T11:18:27.248 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:5ee3514b:::existing_30:head# 2026-02-17T11:18:27.248 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:602f83fe:::foo:head# 2026-02-17T11:18:27.259 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:60426cc7:::existing_62:head# 2026-02-17T11:18:27.259 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:628918ca:::existing_79:head# 2026-02-17T11:18:27.259 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:63f8ab2d:::existing_77:head# 2026-02-17T11:18:27.259 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:67e1780f:::existing_27:head# 2026-02-17T11:18:27.259 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:68143ca1:::existing_71:head# 2026-02-17T11:18:27.259 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:6bac9509:::existing_29:head# 2026-02-17T11:18:27.259 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:6bbec798:::existing_45:head# 2026-02-17T11:18:27.259 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:6cb23a40:::existing_65:head# 2026-02-17T11:18:27.259 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:7055ec5e:::existing_83:head# 2026-02-17T11:18:27.259 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:70a54e2b:::existing_87:head# 2026-02-17T11:18:27.259 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:750ace21:::existing_19:head# 2026-02-17T11:18:27.260 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:78623b1d:::existing_6:head# 2026-02-17T11:18:27.260 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:79881152:::existing_63:head# 2026-02-17T11:18:27.260 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:7a80c0d5:::existing_99:head# 2026-02-17T11:18:27.260 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:81490677:::existing_76:head# 2026-02-17T11:18:27.260 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:85ec8e5d:::existing_85:head# 2026-02-17T11:18:27.260 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:8e2abbf0:::existing_49:head# 2026-02-17T11:18:27.260 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:8ee0fe0f:::existing_52:head# 2026-02-17T11:18:27.260 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:923c5d4d:::existing_5:head# 2026-02-17T11:18:27.260 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:92731e71:::existing_89:head# 2026-02-17T11:18:27.260 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:928205cf:::existing_82:head# 2026-02-17T11:18:27.260 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:93be2267:::existing_24:head# 2026-02-17T11:18:27.260 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:99ceda2c:::existing_44:head# 2026-02-17T11:18:27.260 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:9dd917ee:::existing_26:head# 2026-02-17T11:18:27.261 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:a28805a6:::existing_72:head# 2026-02-17T11:18:27.261 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:a294a8f6:::existing_16:head# 2026-02-17T11:18:27.261 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:a2f5473a:::existing_42:head# 2026-02-17T11:18:27.261 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:a504a533:::existing_90:head# 2026-02-17T11:18:27.261 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:a691337e:::existing_61:head# 2026-02-17T11:18:27.261 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:a6e8d7ac:::existing_28:head# 2026-02-17T11:18:27.261 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:a9fde86e:::existing_18:head# 2026-02-17T11:18:27.261 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:aa309faa:::existing_68:head# 2026-02-17T11:18:27.261 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:ae40b0ed:::existing_31:head# 2026-02-17T11:18:27.261 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:b279b1fe:::existing_10:head# 2026-02-17T11:18:27.261 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:b343e277:::existing_88:head# 2026-02-17T11:18:27.261 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:b7130e90:::existing_80:head# 2026-02-17T11:18:27.261 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:bc6f7309:::existing_70:head# 2026-02-17T11:18:27.262 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:be8489b7:::existing_38:head# 2026-02-17T11:18:27.262 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:beb4e5e3:::existing_47:head# 2026-02-17T11:18:27.262 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:bebec877:::existing_74:head# 2026-02-17T11:18:27.262 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:c04347d8:::existing_60:head# 2026-02-17T11:18:27.262 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:c156033e:::existing_100:head# 2026-02-17T11:18:27.262 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:c19f5a8e:::existing_8:head# 2026-02-17T11:18:27.262 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:c3e6ebe4:::existing_17:head# 2026-02-17T11:18:27.262 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:c6c5a7c2:::existing_39:head# 2026-02-17T11:18:27.262 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:cc1d0abf:::existing_95:head# 2026-02-17T11:18:27.262 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:ccb3865b:::existing_73:head# 2026-02-17T11:18:27.262 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:cd84e19e:::existing_40:head# 2026-02-17T11:18:27.262 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:d2cd64ce:::existing_37:head# 2026-02-17T11:18:27.262 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:d41a25c9:::existing_22:head# 2026-02-17T11:18:27.263 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:d7f088da:::existing_91:head# 2026-02-17T11:18:27.263 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:d9cbd1d6:::existing_64:head# 2026-02-17T11:18:27.263 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:dcc4ff82:::existing_98:head# 2026-02-17T11:18:27.263 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:dd677bd3:::existing_35:head# 2026-02-17T11:18:27.263 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:dd6d90e7:::existing_46:head# 2026-02-17T11:18:27.263 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:e0e22077:::existing_21:head# 2026-02-17T11:18:27.263 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:e255b710:::existing_55:head# 2026-02-17T11:18:27.263 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:eff1d5db:::existing_14:head# 2026-02-17T11:18:27.263 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:f1b156bf:::existing_23:head# 2026-02-17T11:18:27.263 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:f5ce4199:::existing_34:head# 2026-02-17T11:18:27.263 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:f6809456:::existing_11:head# 2026-02-17T11:18:27.263 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:f699a2a9:::existing_67:head# 2026-02-17T11:18:27.263 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:f9baac43:::existing_25:head# 2026-02-17T11:18:27.263 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:fb76688e:::existing_51:head# 2026-02-17T11:18:27.264 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:fbb92eec:::existing_69:head# 2026-02-17T11:18:27.264 INFO:tasks.workunit.client.0.trial148.stderr:Export successful 2026-02-17T11:18:27.264 INFO:tasks.workunit.client.0.trial148.stdout: marking collection for removal 2026-02-17T11:18:27.264 INFO:tasks.workunit.client.0.trial148.stdout:setting '_remove' omap key 2026-02-17T11:18:27.264 INFO:tasks.workunit.client.0.trial148.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-17T11:18:27.265 INFO:tasks.workunit.client.0.trial148.stderr:Remove successful 2026-02-17T11:18:27.792 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:574: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.19803.out 2026-02-17T11:18:27.793 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T11:18:27.793 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T11:18:27.793 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=1 2026-02-17T11:18:27.793 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T11:18:27.793 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T11:18:27.793 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.19803.out 2026-02-17T11:18:28.428 INFO:tasks.workunit.client.0.trial148.stdout:get_pg_num_history pg_num_history pg_num_history(e46 pg_nums {1={21=1}} deleted_pools ) 2026-02-17T11:18:28.429 INFO:tasks.workunit.client.0.trial148.stdout:Importing pgid 1.0 2026-02-17T11:18:28.429 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-17T11:18:28.429 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.429 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-17T11:18:28.429 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.431 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-17T11:18:28.432 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.432 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:091f9f1d:::existing_94:head# 2026-02-17T11:18:28.432 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.432 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:0a865a93:::existing_54:head# 2026-02-17T11:18:28.432 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.432 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:0fed513c:::existing_41:head# 2026-02-17T11:18:28.432 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.432 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:13b9e0b8:::existing_92:head# 2026-02-17T11:18:28.432 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.432 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:169157fa:::existing_81:head# 2026-02-17T11:18:28.432 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.433 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:17731382:::existing_58:head# 2026-02-17T11:18:28.433 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.433 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:18a45a39:::existing_43:head# 2026-02-17T11:18:28.433 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.433 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:1c160f01:::existing_66:head# 2026-02-17T11:18:28.433 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.433 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:1dd6c249:::existing_97:head# 2026-02-17T11:18:28.433 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.437 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:227e0c77:::existing_7:head# 2026-02-17T11:18:28.437 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.438 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:23e1b063:::existing_59:head# 2026-02-17T11:18:28.438 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.438 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:28566edb:::existing_78:head# 2026-02-17T11:18:28.438 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.438 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:2a101182:::existing_20:head# 2026-02-17T11:18:28.438 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.438 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:2d1519da:::existing_96:head# 2026-02-17T11:18:28.438 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.438 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:3078b87a:::existing_86:head# 2026-02-17T11:18:28.438 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.438 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:30bde01b:::existing_15:head# 2026-02-17T11:18:28.438 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.439 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:317a7e19:::existing_56:head# 2026-02-17T11:18:28.439 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.439 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:38b9c7fa:::existing_33:head# 2026-02-17T11:18:28.439 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.439 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:3e16d84b:::existing_48:head# 2026-02-17T11:18:28.439 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.439 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:45fe8203:::existing_75:head# 2026-02-17T11:18:28.439 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.439 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:4e82c9ba:::existing_50:head# 2026-02-17T11:18:28.439 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.439 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:5298dcdb:::existing_57:head# 2026-02-17T11:18:28.439 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.440 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:52ebaa44:::existing_32:head# 2026-02-17T11:18:28.440 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.440 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:53588912:::existing_9:head# 2026-02-17T11:18:28.440 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.440 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:5b7e2de6:::existing_84:head# 2026-02-17T11:18:28.440 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.440 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:5da0255c:::existing_13:head# 2026-02-17T11:18:28.440 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.440 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:5da2dab8:::existing_53:head# 2026-02-17T11:18:28.440 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.440 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:5ee3514b:::existing_30:head# 2026-02-17T11:18:28.440 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.441 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:602f83fe:::foo:head# 2026-02-17T11:18:28.441 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.441 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:60426cc7:::existing_62:head# 2026-02-17T11:18:28.441 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.441 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:628918ca:::existing_79:head# 2026-02-17T11:18:28.441 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.448 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:63f8ab2d:::existing_77:head# 2026-02-17T11:18:28.448 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.448 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:67e1780f:::existing_27:head# 2026-02-17T11:18:28.448 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.448 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:68143ca1:::existing_71:head# 2026-02-17T11:18:28.448 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.448 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:6bac9509:::existing_29:head# 2026-02-17T11:18:28.448 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.449 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:6bbec798:::existing_45:head# 2026-02-17T11:18:28.449 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.449 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:6cb23a40:::existing_65:head# 2026-02-17T11:18:28.449 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.449 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:7055ec5e:::existing_83:head# 2026-02-17T11:18:28.449 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.449 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:70a54e2b:::existing_87:head# 2026-02-17T11:18:28.449 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.449 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:750ace21:::existing_19:head# 2026-02-17T11:18:28.449 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.449 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:78623b1d:::existing_6:head# 2026-02-17T11:18:28.449 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.450 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:79881152:::existing_63:head# 2026-02-17T11:18:28.450 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.450 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:7a80c0d5:::existing_99:head# 2026-02-17T11:18:28.450 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.450 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:81490677:::existing_76:head# 2026-02-17T11:18:28.450 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.450 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:85ec8e5d:::existing_85:head# 2026-02-17T11:18:28.450 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.450 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:8e2abbf0:::existing_49:head# 2026-02-17T11:18:28.450 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.450 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:8ee0fe0f:::existing_52:head# 2026-02-17T11:18:28.450 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.451 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:923c5d4d:::existing_5:head# 2026-02-17T11:18:28.451 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.451 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:92731e71:::existing_89:head# 2026-02-17T11:18:28.451 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.451 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:928205cf:::existing_82:head# 2026-02-17T11:18:28.451 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.451 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:93be2267:::existing_24:head# 2026-02-17T11:18:28.451 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.451 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:99ceda2c:::existing_44:head# 2026-02-17T11:18:28.451 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.451 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:9dd917ee:::existing_26:head# 2026-02-17T11:18:28.451 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.452 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:a28805a6:::existing_72:head# 2026-02-17T11:18:28.452 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.452 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:a294a8f6:::existing_16:head# 2026-02-17T11:18:28.452 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.452 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:a2f5473a:::existing_42:head# 2026-02-17T11:18:28.452 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.452 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:a504a533:::existing_90:head# 2026-02-17T11:18:28.452 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.452 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:a691337e:::existing_61:head# 2026-02-17T11:18:28.452 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.452 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:a6e8d7ac:::existing_28:head# 2026-02-17T11:18:28.452 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.452 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:a9fde86e:::existing_18:head# 2026-02-17T11:18:28.453 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.453 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:aa309faa:::existing_68:head# 2026-02-17T11:18:28.453 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.453 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:ae40b0ed:::existing_31:head# 2026-02-17T11:18:28.453 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.453 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:b279b1fe:::existing_10:head# 2026-02-17T11:18:28.453 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.453 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:b343e277:::existing_88:head# 2026-02-17T11:18:28.453 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.453 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:b7130e90:::existing_80:head# 2026-02-17T11:18:28.453 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.453 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:bc6f7309:::existing_70:head# 2026-02-17T11:18:28.454 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.454 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:be8489b7:::existing_38:head# 2026-02-17T11:18:28.454 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.454 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:beb4e5e3:::existing_47:head# 2026-02-17T11:18:28.454 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.454 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:bebec877:::existing_74:head# 2026-02-17T11:18:28.454 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.459 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:c04347d8:::existing_60:head# 2026-02-17T11:18:28.459 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.459 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:c156033e:::existing_100:head# 2026-02-17T11:18:28.459 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.459 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:c19f5a8e:::existing_8:head# 2026-02-17T11:18:28.459 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.459 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:c3e6ebe4:::existing_17:head# 2026-02-17T11:18:28.459 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.459 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:c6c5a7c2:::existing_39:head# 2026-02-17T11:18:28.460 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.460 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:cc1d0abf:::existing_95:head# 2026-02-17T11:18:28.460 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.460 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:ccb3865b:::existing_73:head# 2026-02-17T11:18:28.460 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.460 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:cd84e19e:::existing_40:head# 2026-02-17T11:18:28.460 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.460 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:d2cd64ce:::existing_37:head# 2026-02-17T11:18:28.460 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.460 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:d41a25c9:::existing_22:head# 2026-02-17T11:18:28.460 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.460 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:d7f088da:::existing_91:head# 2026-02-17T11:18:28.461 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.461 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:d9cbd1d6:::existing_64:head# 2026-02-17T11:18:28.461 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.461 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:dcc4ff82:::existing_98:head# 2026-02-17T11:18:28.461 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.461 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:dd677bd3:::existing_35:head# 2026-02-17T11:18:28.461 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.461 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:dd6d90e7:::existing_46:head# 2026-02-17T11:18:28.461 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.461 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:e0e22077:::existing_21:head# 2026-02-17T11:18:28.461 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.461 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:e255b710:::existing_55:head# 2026-02-17T11:18:28.461 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.462 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:eff1d5db:::existing_14:head# 2026-02-17T11:18:28.462 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.462 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:f1b156bf:::existing_23:head# 2026-02-17T11:18:28.462 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.462 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:f5ce4199:::existing_34:head# 2026-02-17T11:18:28.462 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.462 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:f6809456:::existing_11:head# 2026-02-17T11:18:28.462 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.462 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:f699a2a9:::existing_67:head# 2026-02-17T11:18:28.462 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.462 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:f9baac43:::existing_25:head# 2026-02-17T11:18:28.462 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.462 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:fb76688e:::existing_51:head# 2026-02-17T11:18:28.462 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.463 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:fbb92eec:::existing_69:head# 2026-02-17T11:18:28.463 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:18:28.463 INFO:tasks.workunit.client.0.trial148.stdout:write_pg epoch 46 info 1.0( v 46'102 lc 0'0 (26'90,46'102] local-lis/les=45/46 n=101 ec=21/21 lis/c=45/21 les/c/f=46/22/0 sis=45) 2026-02-17T11:18:28.463 INFO:tasks.workunit.client.0.trial148.stdout:Import successful 2026-02-17T11:18:28.993 INFO:tasks.workunit.client.0.trial148.stdout:reviving divergent 1 2026-02-17T11:18:28.993 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:576: TEST_divergent_2: echo 'reviving divergent 1' 2026-02-17T11:18:28.994 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:577: TEST_divergent_2: ceph pg dump pgs 2026-02-17T11:18:29.184 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:18:29.184 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 100 0 0 69772 0 0 17 84 17 active+undersized+degraded 2026-02-17T11:17:19.245598+0000 40'101 42:132 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:16:42.441928+0000 0'0 2026-02-17T11:16:42.441928+0000 0 0 periodic scrub scheduled @ 2026-02-18T13:55:36.229528+0000 0 0 2026-02-17T11:18:29.184 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:18:29.184 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:18:29.184 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:18:29.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:578: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-17T11:18:29.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/divergent-priors 2026-02-17T11:18:29.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:18:29.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T11:18:29.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:18:29.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T11:18:29.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:18:29.196 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:18:29.196 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:18:29.196 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:18:29.196 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T11:18:29.196 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T11:18:29.196 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:18:29.196 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:18:29.196 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:18:29.196 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:18:29.196 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:18:29.196 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:18:29.197 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:18:29.197 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:18:29.197 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:18:29.197 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:18:29.197 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:18:29.197 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:18:29.197 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:18:29.197 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:18:29.197 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:18:29.197 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:18:29.197 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:18:29.197 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:18:29.197 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:18:29.198 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:18:29.198 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T11:18:29.198 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T11:18:29.199 INFO:tasks.workunit.client.0.trial148.stdout:start osd.1 2026-02-17T11:18:29.199 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:18:29.200 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T11:18:29.200 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T11:18:29.200 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:18:29.200 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:18:29.200 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:18:29.221 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:18:29.218+0000 7fc1916cf8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:18:29.223 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:18:29.222+0000 7fc1916cf8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:18:29.224 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:18:29.222+0000 7fc1916cf8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:18:29.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2026-02-17T11:18:29.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:18:29.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T11:18:29.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:18:29.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:18:29.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:18:29.397 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:18:29.398 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:18:29.398 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:18:29.398 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:18:29.603 INFO:tasks.workunit.client.0.trial148.stdout:osd.1 up in weight 1 up_from 45 up_thru 45 down_at 28 last_clean_interval [9,26) [v2:127.0.0.1:6818/2625496280,v1:127.0.0.1:6819/2625496280] [v2:127.0.0.1:6820/2625496280,v1:127.0.0.1:6821/2625496280] exists,up ed659628-1e35-4975-9a8a-0acf011e4716 2026-02-17T11:18:29.604 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:18:29.604 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:18:29.604 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:18:29.604 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:579: TEST_divergent_2: wait_for_osd up 1 2026-02-17T11:18:29.604 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:18:29.605 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T11:18:29.605 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:18:29.605 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:18:29.605 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:18:29.605 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:18:29.606 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:18:29.606 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:18:29.606 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:18:29.806 INFO:tasks.workunit.client.0.trial148.stdout:osd.1 up in weight 1 up_from 45 up_thru 45 down_at 28 last_clean_interval [9,26) [v2:127.0.0.1:6818/2625496280,v1:127.0.0.1:6819/2625496280] [v2:127.0.0.1:6820/2625496280,v1:127.0.0.1:6821/2625496280] exists,up ed659628-1e35-4975-9a8a-0acf011e4716 2026-02-17T11:18:29.806 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:18:29.807 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:18:29.807 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:18:29.807 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:581: TEST_divergent_2: sleep 20 2026-02-17T11:18:30.492 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:18:30.490+0000 7fc1916cf8c0 -1 Falling back to public interface 2026-02-17T11:18:33.437 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:18:33.434+0000 7fc1916cf8c0 -1 osd.1 46 log_to_monitors true 2026-02-17T11:18:49.809 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:582: TEST_divergent_2: get_asok_path osd.1 2026-02-17T11:18:49.809 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T11:18:49.809 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T11:18:49.810 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:18:49.810 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:18:49.810 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:18:49.810 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.1.asok 2026-02-17T11:18:49.810 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:582: TEST_divergent_2: CEPH_ARGS= 2026-02-17T11:18:49.810 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:582: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.1.asok dump_ops_in_flight 2026-02-17T11:18:49.873 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:18:49.873 INFO:tasks.workunit.client.0.trial148.stdout: "ops": [], 2026-02-17T11:18:49.873 INFO:tasks.workunit.client.0.trial148.stdout: "num_ops": 0 2026-02-17T11:18:49.874 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:18:49.879 INFO:tasks.workunit.client.0.trial148.stdout:allowing recovery 2026-02-17T11:18:49.879 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:584: TEST_divergent_2: echo 'allowing recovery' 2026-02-17T11:18:49.879 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: ceph pg dump pgs 2026-02-17T11:18:50.076 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:18:50.076 INFO:tasks.workunit.client.0.trial148.stdout:1.0 101 0 0 0 0 70467 0 0 12 90 12 active+clean 2026-02-17T11:18:34.781102+0000 46'102 50:159 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:16:42.441928+0000 0'0 2026-02-17T11:16:42.441928+0000 0 0 periodic scrub scheduled @ 2026-02-18T19:14:37.046457+0000 0 0 2026-02-17T11:18:50.076 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:18:50.076 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:18:50.077 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:18:50.087 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:587: TEST_divergent_2: for i in $osds 2026-02-17T11:18:50.087 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:589: TEST_divergent_2: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-17T11:18:50.158 INFO:tasks.workunit.client.0.trial148.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T11:18:50.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:587: TEST_divergent_2: for i in $osds 2026-02-17T11:18:50.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:589: TEST_divergent_2: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-17T11:18:50.245 INFO:tasks.workunit.client.0.trial148.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T11:18:50.253 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:587: TEST_divergent_2: for i in $osds 2026-02-17T11:18:50.253 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:589: TEST_divergent_2: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-17T11:18:50.334 INFO:tasks.workunit.client.0.trial148.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T11:18:50.341 INFO:tasks.workunit.client.0.trial148.stdout:reading divergent objects 2026-02-17T11:18:50.341 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: echo 'reading divergent objects' 2026-02-17T11:18:50.342 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:593: TEST_divergent_2: ceph pg dump pgs 2026-02-17T11:18:50.540 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:18:50.540 INFO:tasks.workunit.client.0.trial148.stdout:1.0 101 0 0 0 0 70467 0 0 12 90 12 active+clean 2026-02-17T11:18:34.781102+0000 46'102 50:159 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:16:42.441928+0000 0'0 2026-02-17T11:16:42.441928+0000 0 0 periodic scrub scheduled @ 2026-02-18T19:14:37.046457+0000 0 0 2026-02-17T11:18:50.540 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:18:50.540 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:18:50.540 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:18:50.549 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:594: TEST_divergent_2: expr 2 + 2 2026-02-17T11:18:50.550 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:594: TEST_divergent_2: seq 1 4 2026-02-17T11:18:50.551 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:594: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T11:18:50.551 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:596: TEST_divergent_2: rados -p test get existing_1 td/divergent-priors/existing 2026-02-17T11:18:50.573 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:594: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T11:18:50.573 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:596: TEST_divergent_2: rados -p test get existing_2 td/divergent-priors/existing 2026-02-17T11:18:50.601 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:594: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T11:18:50.601 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:596: TEST_divergent_2: rados -p test get existing_3 td/divergent-priors/existing 2026-02-17T11:18:50.628 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:594: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T11:18:50.628 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:596: TEST_divergent_2: rados -p test get existing_4 td/divergent-priors/existing 2026-02-17T11:18:50.656 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:598: TEST_divergent_2: seq 1 2 2026-02-17T11:18:50.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:598: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T11:18:50.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:600: TEST_divergent_2: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-17T11:18:50.677 INFO:tasks.workunit.client.0.trial148.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-17T11:18:50.678 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:598: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T11:18:50.679 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:600: TEST_divergent_2: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-17T11:18:50.705 INFO:tasks.workunit.client.0.trial148.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-17T11:18:50.707 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:602: TEST_divergent_2: rm -f td/divergent-priors/existing 2026-02-17T11:18:50.709 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:604: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-17T11:18:50.710 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:604: TEST_divergent_2: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T11:18:50.713 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 26'106 (26'4) delete 1:70b3bf12:::existing_4:head by client.4567.0:1 2026-02-17T11:16:56.178695+0000 0 ObjectCleanRegions clean_offsets: [(695, 18446744073709550920)], clean_omap: false, new_object: false 2026-02-17T11:18:50.713 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 20 _merge_object_divergent_entries: keeping 26'106 (26'4) delete 1:70b3bf12:::existing_4:head by client.4567.0:1 2026-02-17T11:16:56.178695+0000 0 ObjectCleanRegions clean_offsets: [(695, 18446744073709550920)], clean_omap: false, new_object: false 2026-02-17T11:18:50.713 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T11:18:50.713 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 26'4 first_divergent_update: 26'106 last_divergent_update: 26'106 2026-02-17T11:18:50.713 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: more recent entry found: 40'101 (26'4) modify 1:70b3bf12:::existing_4:head by client.4690.0:1 2026-02-17T11:17:49.667816+0000 0 ObjectCleanRegions clean_offsets: [(967, 18446744073709550648)], clean_omap: true, new_object: false, already merged 2026-02-17T11:18:50.713 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 26'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4553.0:1 2026-02-17T11:16:56.171620+0000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false 2026-02-17T11:18:50.713 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 20 _merge_object_divergent_entries: keeping 26'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4553.0:1 2026-02-17T11:16:56.171620+0000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false 2026-02-17T11:18:50.713 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T11:18:50.714 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 26'101 last_divergent_update: 26'101 2026-02-17T11:18:50.714 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-17T11:18:50.714 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-17T11:18:50.714 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 26'105 (26'3) delete 1:8881e6d8:::existing_3:head by client.4566.0:1 2026-02-17T11:16:56.178089+0000 0 ObjectCleanRegions clean_offsets: [(695, 18446744073709550920)], clean_omap: false, new_object: false 2026-02-17T11:18:50.714 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 20 _merge_object_divergent_entries: keeping 26'105 (26'3) delete 1:8881e6d8:::existing_3:head by client.4566.0:1 2026-02-17T11:16:56.178089+0000 0 ObjectCleanRegions clean_offsets: [(695, 18446744073709550920)], clean_omap: false, new_object: false 2026-02-17T11:18:50.714 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-17T11:18:50.714 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 26'3 first_divergent_update: 26'105 last_divergent_update: 26'105 2026-02-17T11:18:50.714 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-17T11:18:50.714 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-17T11:18:50.714 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 26'106 2026-02-17T11:18:50.714 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 26'105 (26'3) delete 1:8881e6d8:::existing_3:head by client.4566.0:1 2026-02-17T11:16:56.178089+0000 0 ObjectCleanRegions clean_offsets: [(695, 18446744073709550920)], clean_omap: false, new_object: false 2026-02-17T11:18:50.714 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-17T11:18:50.715 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 26'3 <= info.log_tail 26'90 2026-02-17T11:18:50.715 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 26'104 (26'2) modify 1:97db2a0f:::existing_2:head by client.4561.0:1 2026-02-17T11:16:56.174690+0000 0 ObjectCleanRegions clean_offsets: [(967, 18446744073709550648)], clean_omap: true, new_object: false 2026-02-17T11:18:50.715 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 20 _merge_object_divergent_entries: keeping 26'104 (26'2) modify 1:97db2a0f:::existing_2:head by client.4561.0:1 2026-02-17T11:16:56.174690+0000 0 ObjectCleanRegions clean_offsets: [(967, 18446744073709550648)], clean_omap: true, new_object: false 2026-02-17T11:18:50.715 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T11:18:50.715 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 26'2 first_divergent_update: 26'104 last_divergent_update: 26'104 2026-02-17T11:18:50.715 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-17T11:18:50.715 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-17T11:18:50.715 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 26'106 2026-02-17T11:18:50.715 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 26'104 (26'2) modify 1:97db2a0f:::existing_2:head by client.4561.0:1 2026-02-17T11:16:56.174690+0000 0 ObjectCleanRegions clean_offsets: [(967, 18446744073709550648)], clean_omap: true, new_object: false 2026-02-17T11:18:50.715 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-17T11:18:50.715 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 26'2 <= info.log_tail 26'90 2026-02-17T11:18:50.715 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 26'103 (26'1) modify 1:d858c035:::existing_1:head by client.4560.0:1 2026-02-17T11:16:56.174423+0000 0 ObjectCleanRegions clean_offsets: [(967, 18446744073709550648)], clean_omap: true, new_object: false 2026-02-17T11:18:50.715 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 20 _merge_object_divergent_entries: keeping 26'103 (26'1) modify 1:d858c035:::existing_1:head by client.4560.0:1 2026-02-17T11:16:56.174423+0000 0 ObjectCleanRegions clean_offsets: [(967, 18446744073709550648)], clean_omap: true, new_object: false 2026-02-17T11:18:50.716 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T11:18:50.716 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 26'1 first_divergent_update: 26'103 last_divergent_update: 26'103 2026-02-17T11:18:50.716 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-17T11:18:50.716 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-17T11:18:50.716 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 26'106 2026-02-17T11:18:50.717 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 26'103 (26'1) modify 1:d858c035:::existing_1:head by client.4560.0:1 2026-02-17T11:16:56.174423+0000 0 ObjectCleanRegions clean_offsets: [(967, 18446744073709550648)], clean_omap: true, new_object: false 2026-02-17T11:18:50.717 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-17T11:18:50.717 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 26'1 <= info.log_tail 26'90 2026-02-17T11:18:50.717 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 26'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4557.0:1 2026-02-17T11:16:56.173015+0000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false 2026-02-17T11:18:50.717 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 20 _merge_object_divergent_entries: keeping 26'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4557.0:1 2026-02-17T11:16:56.173015+0000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false 2026-02-17T11:18:50.717 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T11:18:50.717 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 26'102 last_divergent_update: 26'102 2026-02-17T11:18:50.717 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-17T11:18:50.717 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:18:25.342+0000 7f6e9d72a640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-17T11:18:50.718 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:606: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-17T11:18:50.718 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:606: TEST_divergent_2: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T11:18:50.719 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:612: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-17T11:18:50.720 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:612: TEST_divergent_2: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T11:18:50.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:617: TEST_divergent_2: echo success 2026-02-17T11:18:50.724 INFO:tasks.workunit.client.0.trial148.stdout:success 2026-02-17T11:18:50.725 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:619: TEST_divergent_2: rm td/divergent-priors/td/divergent-priors/exp.19803.out 2026-02-17T11:18:50.725 INFO:tasks.workunit.client.0.trial148.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.19803.out': No such file or directory 2026-02-17T11:18:50.725 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:621: TEST_divergent_2: delete_pool test 2026-02-17T11:18:50.725 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test 2026-02-17T11:18:50.725 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-17T11:18:50.977 INFO:tasks.workunit.client.0.trial148.stderr:pool 'test' does not exist 2026-02-17T11:18:50.986 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:622: TEST_divergent_2: kill_daemons td/divergent-priors 2026-02-17T11:18:50.987 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:18:50.987 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:18:50.987 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:18:50.987 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:18:50.988 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:18:59.305 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:18:59.305 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-17T11:18:59.305 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/divergent-priors 2026-02-17T11:18:59.305 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T11:18:59.305 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T11:18:59.305 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:18:59.306 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:18:59.306 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:18:59.306 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:18:59.306 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:18:59.313 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:18:59.314 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:18:59.315 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:18:59.315 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:18:59.316 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:18:59.316 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:18:59.316 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:18:59.317 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:18:59.317 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:18:59.318 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:18:59.318 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:18:59.319 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:18:59.320 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T11:18:59.320 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/divergent-priors 2026-02-17T11:18:59.342 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:18:59.342 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:18:59.343 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:18:59.343 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.19803 2026-02-17T11:18:59.344 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T11:18:59.344 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T11:18:59.344 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-17T11:18:59.344 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-17T11:18:59.344 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/divergent-priors 2026-02-17T11:18:59.344 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/divergent-priors 2026-02-17T11:18:59.344 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/divergent-priors 2026-02-17T11:18:59.344 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T11:18:59.344 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T11:18:59.345 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:18:59.345 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:18:59.345 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:18:59.345 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:18:59.345 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:18:59.347 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:18:59.347 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:18:59.348 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:18:59.348 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:18:59.349 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:18:59.349 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:18:59.349 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:18:59.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:18:59.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:18:59.351 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:18:59.351 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:18:59.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:18:59.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T11:18:59.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/divergent-priors 2026-02-17T11:18:59.354 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:18:59.354 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:18:59.354 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:18:59.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.19803 2026-02-17T11:18:59.355 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T11:18:59.355 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T11:18:59.355 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/divergent-priors 2026-02-17T11:18:59.356 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T11:18:59.357 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:18:59.357 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:18:59.357 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.19803 2026-02-17T11:18:59.359 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T11:18:59.359 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T11:18:59.359 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T11:18:59.359 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-17T11:18:59.359 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_3 td/divergent-priors 2026-02-17T11:18:59.360 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:628: TEST_divergent_3: local dir=td/divergent-priors 2026-02-17T11:18:59.360 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:631: TEST_divergent_3: local dummyfile=/etc/fstab 2026-02-17T11:18:59.360 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: local dummyfile2=/etc/resolv.conf 2026-02-17T11:18:59.360 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: local num_osds=3 2026-02-17T11:18:59.360 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:635: TEST_divergent_3: expr 3 - 1 2026-02-17T11:18:59.361 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:635: TEST_divergent_3: seq 0 2 2026-02-17T11:18:59.363 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:635: TEST_divergent_3: local 'osds=0 2026-02-17T11:18:59.363 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:18:59.363 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:18:59.363 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:636: TEST_divergent_3: run_mon td/divergent-priors a 2026-02-17T11:18:59.363 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/divergent-priors 2026-02-17T11:18:59.363 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T11:18:59.363 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T11:18:59.363 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T11:18:59.363 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/divergent-priors/a 2026-02-17T11:18:59.363 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-17T11:18:59.394 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T11:18:59.394 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:18:59.394 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:18:59.394 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:18:59.394 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:18:59.394 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:18:59.395 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:18:59.395 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T11:18:59.426 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T11:18:59.427 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T11:18:59.427 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T11:18:59.427 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T11:18:59.427 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T11:18:59.428 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T11:18:59.429 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T11:18:59.429 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T11:18:59.429 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T11:18:59.429 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:18:59.429 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:18:59.429 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:18:59.429 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-mon.a.asok 2026-02-17T11:18:59.429 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T11:18:59.429 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.19803/ceph-mon.a.asok config get fsid 2026-02-17T11:18:59.484 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T11:18:59.485 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T11:18:59.485 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T11:18:59.485 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T11:18:59.485 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T11:18:59.485 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T11:18:59.485 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T11:18:59.485 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T11:18:59.486 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:18:59.486 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:18:59.486 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:18:59.486 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-mon.a.asok 2026-02-17T11:18:59.487 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T11:18:59.487 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.19803/ceph-mon.a.asok config get mon_host 2026-02-17T11:18:59.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: run_mgr td/divergent-priors x 2026-02-17T11:18:59.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/divergent-priors 2026-02-17T11:18:59.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T11:18:59.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T11:18:59.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T11:18:59.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/divergent-priors/x 2026-02-17T11:18:59.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T11:18:59.649 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T11:18:59.649 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:18:59.649 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:18:59.650 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:18:59.650 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:18:59.650 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:18:59.650 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:18:59.650 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T11:18:59.651 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T11:18:59.673 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:638: TEST_divergent_3: for i in $osds 2026-02-17T11:18:59.674 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: run_osd td/divergent-priors 0 2026-02-17T11:18:59.674 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/divergent-priors 2026-02-17T11:18:59.674 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:18:59.674 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T11:18:59.674 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:18:59.674 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/divergent-priors/0 2026-02-17T11:18:59.674 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:18:59.674 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:18:59.674 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:18:59.674 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:18:59.674 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T11:18:59.674 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T11:18:59.675 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:18:59.675 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:18:59.675 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:18:59.675 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:18:59.675 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:18:59.675 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:18:59.675 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:18:59.675 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:18:59.675 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:18:59.675 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:18:59.675 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:18:59.675 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:18:59.675 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:18:59.676 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:18:59.676 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:18:59.676 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:18:59.676 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:18:59.676 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:18:59.676 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:18:59.676 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:18:59.676 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:18:59.676 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:18:59.676 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/divergent-priors/0 2026-02-17T11:18:59.677 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:18:59.677 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=445c6994-5669-4311-9e55-f2c103270e94 2026-02-17T11:18:59.677 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 445c6994-5669-4311-9e55-f2c103270e94' 2026-02-17T11:18:59.677 INFO:tasks.workunit.client.0.trial148.stdout:add osd0 445c6994-5669-4311-9e55-f2c103270e94 2026-02-17T11:18:59.678 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:18:59.689 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCjTpRp1U7/KBAAutKJGWHnb/4ghb0LF93j7A== 2026-02-17T11:18:59.690 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCjTpRp1U7/KBAAutKJGWHnb/4ghb0LF93j7A=="}' 2026-02-17T11:18:59.690 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 445c6994-5669-4311-9e55-f2c103270e94 -i td/divergent-priors/0/new.json 2026-02-17T11:18:59.807 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:18:59.815 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/divergent-priors/0/new.json 2026-02-17T11:18:59.816 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCjTpRp1U7/KBAAutKJGWHnb/4ghb0LF93j7A== --osd-uuid 445c6994-5669-4311-9e55-f2c103270e94 2026-02-17T11:18:59.835 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:18:59.833+0000 7fe9ca20e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:18:59.837 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:18:59.833+0000 7fe9ca20e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:18:59.838 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:18:59.833+0000 7fe9ca20e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:18:59.838 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:18:59.833+0000 7fe9ca20e8c0 -1 bdev(0x559524ef3c00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-17T11:18:59.838 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:18:59.833+0000 7fe9ca20e8c0 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-17T11:19:02.655 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-17T11:19:02.656 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:19:02.657 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T11:19:02.657 INFO:tasks.workunit.client.0.trial148.stdout:adding osd0 key to auth repository 2026-02-17T11:19:02.657 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:19:02.931 INFO:tasks.workunit.client.0.trial148.stdout:start osd.0 2026-02-17T11:19:02.932 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T11:19:02.932 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:19:02.932 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:19:02.932 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:19:02.932 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:19:02.959 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:02.957+0000 7f42fffae8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:02.961 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:02.957+0000 7f42fffae8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:02.962 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:02.957+0000 7f42fffae8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:03.141 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T11:19:03.141 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:19:03.141 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T11:19:03.141 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:19:03.141 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:19:03.141 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:03.141 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:19:03.142 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:19:03.142 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:03.142 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:19:03.339 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:19:04.341 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:19:04.341 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:04.341 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:19:04.341 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:19:04.342 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:04.342 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:19:04.477 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:04.473+0000 7f42fffae8c0 -1 Falling back to public interface 2026-02-17T11:19:04.540 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:19:05.542 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:19:05.542 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:05.543 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:19:05.543 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:19:05.544 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:05.544 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:19:05.741 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:19:06.742 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:19:06.742 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:06.742 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:19:06.742 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:19:06.742 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:06.743 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:19:06.948 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:19:07.528 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:07.525+0000 7f42fffae8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T11:19:07.950 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:19:07.950 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:07.951 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:19:07.952 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:19:07.952 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:07.952 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:19:08.153 INFO:tasks.workunit.client.0.trial148.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/4007663251,v1:127.0.0.1:6803/4007663251] [v2:127.0.0.1:6804/4007663251,v1:127.0.0.1:6805/4007663251] exists,up 445c6994-5669-4311-9e55-f2c103270e94 2026-02-17T11:19:08.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:19:08.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:19:08.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:19:08.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:638: TEST_divergent_3: for i in $osds 2026-02-17T11:19:08.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: run_osd td/divergent-priors 1 2026-02-17T11:19:08.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/divergent-priors 2026-02-17T11:19:08.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:19:08.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T11:19:08.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:19:08.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/divergent-priors/1 2026-02-17T11:19:08.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:19:08.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:19:08.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:19:08.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:19:08.154 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T11:19:08.155 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T11:19:08.155 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:19:08.155 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:19:08.155 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:19:08.155 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:19:08.155 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:19:08.155 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:19:08.156 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:19:08.156 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:19:08.156 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:19:08.156 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:19:08.156 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:19:08.156 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:19:08.156 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:19:08.156 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:19:08.156 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:19:08.156 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:19:08.156 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:19:08.156 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:19:08.156 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:19:08.156 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:19:08.157 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:19:08.157 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:19:08.157 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/divergent-priors/1 2026-02-17T11:19:08.157 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:19:08.157 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=2c40e141-b07b-4dad-aaf4-9c213ae159a3 2026-02-17T11:19:08.157 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 2c40e141-b07b-4dad-aaf4-9c213ae159a3' 2026-02-17T11:19:08.158 INFO:tasks.workunit.client.0.trial148.stdout:add osd1 2c40e141-b07b-4dad-aaf4-9c213ae159a3 2026-02-17T11:19:08.158 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:19:08.172 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQCsTpRp3W4lChAABjQyj0JnlhGloM1jERkluQ== 2026-02-17T11:19:08.172 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQCsTpRp3W4lChAABjQyj0JnlhGloM1jERkluQ=="}' 2026-02-17T11:19:08.172 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 2c40e141-b07b-4dad-aaf4-9c213ae159a3 -i td/divergent-priors/1/new.json 2026-02-17T11:19:08.369 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:19:08.378 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/divergent-priors/1/new.json 2026-02-17T11:19:08.379 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCsTpRp3W4lChAABjQyj0JnlhGloM1jERkluQ== --osd-uuid 2c40e141-b07b-4dad-aaf4-9c213ae159a3 2026-02-17T11:19:08.398 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:08.393+0000 7f01fd4898c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:08.399 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:08.393+0000 7f01fd4898c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:08.400 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:08.397+0000 7f01fd4898c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:08.401 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:08.397+0000 7f01fd4898c0 -1 bdev(0x5624e9827c00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-17T11:19:08.401 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:08.397+0000 7f01fd4898c0 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-17T11:19:10.664 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-17T11:19:10.664 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:19:10.665 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T11:19:10.665 INFO:tasks.workunit.client.0.trial148.stdout:adding osd1 key to auth repository 2026-02-17T11:19:10.666 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:19:10.936 INFO:tasks.workunit.client.0.trial148.stdout:start osd.1 2026-02-17T11:19:10.937 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T11:19:10.937 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:19:10.937 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:19:10.937 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:19:10.937 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:19:10.964 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:10.961+0000 7f8e0a50f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:10.966 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:10.961+0000 7f8e0a50f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:10.967 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:10.961+0000 7f8e0a50f8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:11.138 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T11:19:11.138 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:19:11.139 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T11:19:11.139 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:19:11.139 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:19:11.139 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:11.139 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:19:11.140 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:19:11.140 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:11.140 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:19:11.333 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:19:12.334 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:19:12.334 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:12.335 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:19:12.336 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:19:12.336 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:12.336 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:19:12.505 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:12.501+0000 7f8e0a50f8c0 -1 Falling back to public interface 2026-02-17T11:19:12.533 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:19:13.534 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:19:13.535 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:13.535 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:19:13.535 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:19:13.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:13.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:19:13.734 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:19:14.736 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:19:14.736 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:14.737 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:19:14.737 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:19:14.737 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:14.737 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:19:14.933 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:19:15.587 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:15.581+0000 7f8e0a50f8c0 -1 osd.1 0 log_to_monitors true 2026-02-17T11:19:15.934 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:19:15.935 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:15.935 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:19:15.935 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:19:15.935 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:15.935 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:19:16.140 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:19:17.142 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:19:17.142 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:17.142 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T11:19:17.142 INFO:tasks.workunit.client.0.trial148.stdout:5 2026-02-17T11:19:17.143 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:17.143 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:19:17.346 INFO:tasks.workunit.client.0.trial148.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2601695318,v1:127.0.0.1:6811/2601695318] [v2:127.0.0.1:6812/2601695318,v1:127.0.0.1:6813/2601695318] exists,up 2c40e141-b07b-4dad-aaf4-9c213ae159a3 2026-02-17T11:19:17.349 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:19:17.349 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:19:17.349 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:19:17.349 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:638: TEST_divergent_3: for i in $osds 2026-02-17T11:19:17.349 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: run_osd td/divergent-priors 2 2026-02-17T11:19:17.349 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/divergent-priors 2026-02-17T11:19:17.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:19:17.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T11:19:17.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:19:17.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/divergent-priors/2 2026-02-17T11:19:17.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:19:17.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:19:17.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:19:17.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:19:17.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T11:19:17.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T11:19:17.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:19:17.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:19:17.351 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:19:17.351 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:19:17.351 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:19:17.351 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:19:17.351 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:19:17.351 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:19:17.351 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:19:17.351 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:19:17.351 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:19:17.351 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:19:17.351 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:19:17.351 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:19:17.351 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:19:17.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:19:17.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:19:17.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:19:17.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:19:17.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:19:17.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:19:17.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:19:17.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/divergent-priors/2 2026-02-17T11:19:17.353 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:19:17.353 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=2dfcc774-bf64-4f70-a754-84bb2859cd23 2026-02-17T11:19:17.353 INFO:tasks.workunit.client.0.trial148.stdout:add osd2 2dfcc774-bf64-4f70-a754-84bb2859cd23 2026-02-17T11:19:17.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 2dfcc774-bf64-4f70-a754-84bb2859cd23' 2026-02-17T11:19:17.354 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:19:17.364 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQC1TpRpQAKYFRAAZpJBC+2273ZtloFtaA5hug== 2026-02-17T11:19:17.364 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQC1TpRpQAKYFRAAZpJBC+2273ZtloFtaA5hug=="}' 2026-02-17T11:19:17.364 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 2dfcc774-bf64-4f70-a754-84bb2859cd23 -i td/divergent-priors/2/new.json 2026-02-17T11:19:17.565 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:19:17.574 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/divergent-priors/2/new.json 2026-02-17T11:19:17.575 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQC1TpRpQAKYFRAAZpJBC+2273ZtloFtaA5hug== --osd-uuid 2dfcc774-bf64-4f70-a754-84bb2859cd23 2026-02-17T11:19:17.594 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:17.589+0000 7efeb91968c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:17.595 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:17.593+0000 7efeb91968c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:17.596 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:17.593+0000 7efeb91968c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:17.597 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:17.593+0000 7efeb91968c0 -1 bdev(0x55f59f6cdc00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-17T11:19:17.597 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:17.593+0000 7efeb91968c0 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-17T11:19:19.876 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-17T11:19:19.877 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:19:19.877 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T11:19:19.878 INFO:tasks.workunit.client.0.trial148.stdout:adding osd2 key to auth repository 2026-02-17T11:19:19.878 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:19:20.161 INFO:tasks.workunit.client.0.trial148.stdout:start osd.2 2026-02-17T11:19:20.162 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T11:19:20.162 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:19:20.162 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:19:20.163 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:19:20.163 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:19:20.179 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:20.173+0000 7ff43779d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:20.181 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:20.177+0000 7ff43779d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:20.181 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:20.177+0000 7ff43779d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:20.362 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T11:19:20.362 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:19:20.362 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T11:19:20.362 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:19:20.362 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:19:20.362 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:20.362 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:19:20.362 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:19:20.363 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:20.363 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:19:20.562 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:19:21.563 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:19:21.564 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:21.564 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:19:21.565 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:19:21.565 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:21.565 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:19:21.673 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:21.668+0000 7ff43779d8c0 -1 Falling back to public interface 2026-02-17T11:19:21.761 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:19:22.763 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:19:22.763 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:22.764 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:19:22.764 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:19:22.765 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:22.765 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:19:22.959 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:19:23.960 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:19:23.960 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:23.960 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:19:23.961 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:19:23.961 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:23.961 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:19:24.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:19:24.879 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:24.872+0000 7ff43779d8c0 -1 osd.2 0 log_to_monitors true 2026-02-17T11:19:25.160 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:19:25.161 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:25.161 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:19:25.162 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:19:25.162 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:25.163 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:19:25.368 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:19:26.370 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:19:26.370 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:26.371 INFO:tasks.workunit.client.0.trial148.stdout:5 2026-02-17T11:19:26.371 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T11:19:26.372 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:26.372 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:19:26.568 INFO:tasks.workunit.client.0.trial148.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/199751892,v1:127.0.0.1:6819/199751892] [v2:127.0.0.1:6820/199751892,v1:127.0.0.1:6821/199751892] exists,up 2dfcc774-bf64-4f70-a754-84bb2859cd23 2026-02-17T11:19:26.569 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:19:26.569 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:19:26.569 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:19:26.569 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:643: TEST_divergent_3: ceph osd set noout 2026-02-17T11:19:26.864 INFO:tasks.workunit.client.0.trial148.stderr:noout is set 2026-02-17T11:19:26.874 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:644: TEST_divergent_3: ceph osd set noin 2026-02-17T11:19:27.167 INFO:tasks.workunit.client.0.trial148.stderr:noin is set 2026-02-17T11:19:27.178 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:645: TEST_divergent_3: ceph osd set nodown 2026-02-17T11:19:27.473 INFO:tasks.workunit.client.0.trial148.stderr:nodown is set 2026-02-17T11:19:27.483 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:646: TEST_divergent_3: create_pool test 1 1 2026-02-17T11:19:27.484 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 2026-02-17T11:19:27.723 INFO:tasks.workunit.client.0.trial148.stderr:pool 'test' already exists 2026-02-17T11:19:27.734 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T11:19:28.736 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:647: TEST_divergent_3: ceph osd pool set test size 3 2026-02-17T11:19:29.030 INFO:tasks.workunit.client.0.trial148.stderr:set pool 1 size to 3 2026-02-17T11:19:29.042 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:648: TEST_divergent_3: ceph osd pool set test min_size 2 2026-02-17T11:19:29.334 INFO:tasks.workunit.client.0.trial148.stderr:set pool 1 min_size to 2 2026-02-17T11:19:29.346 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:651: TEST_divergent_3: ceph osd pool set test pg_autoscale_mode on 2026-02-17T11:19:29.638 INFO:tasks.workunit.client.0.trial148.stderr:set pool 1 pg_autoscale_mode to on 2026-02-17T11:19:29.648 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:653: TEST_divergent_3: divergent=-1 2026-02-17T11:19:29.648 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:654: TEST_divergent_3: date +%s 2026-02-17T11:19:29.649 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:654: TEST_divergent_3: start_time=1771327169 2026-02-17T11:19:29.649 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:655: TEST_divergent_3: max_duration=300 2026-02-17T11:19:29.650 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:657: TEST_divergent_3: '[' -1 -le -1 ']' 2026-02-17T11:19:29.650 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: flush_pg_stats 2026-02-17T11:19:29.650 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:19:29.650 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:19:29.851 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:19:29.851 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:19:29.851 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:19:29.851 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:19:29.851 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:19:29.851 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:19:29.930 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836487 2026-02-17T11:19:29.931 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836487 2026-02-17T11:19:29.931 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T11:19:29.931 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:19:29.931 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:19:30.009 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=42949672965 2026-02-17T11:19:30.009 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 42949672965 2026-02-17T11:19:30.010 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487 1-42949672965' 2026-02-17T11:19:30.010 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:19:30.010 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:19:30.090 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=60129542147 2026-02-17T11:19:30.090 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 60129542147 2026-02-17T11:19:30.090 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487 1-42949672965 2-60129542147' 2026-02-17T11:19:30.090 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:19:30.090 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836487 2026-02-17T11:19:30.091 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:19:30.092 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:19:30.092 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836487 2026-02-17T11:19:30.093 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:19:30.094 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836487 2026-02-17T11:19:30.094 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T11:19:30.094 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 21474836487 2026-02-17T11:19:30.095 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:19:30.314 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-17T11:19:30.314 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:19:31.315 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:19:31.316 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:19:31.516 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-17T11:19:31.516 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:19:32.517 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T11:19:32.517 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:19:32.725 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T11:19:32.726 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:19:32.726 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-42949672965 2026-02-17T11:19:32.726 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:19:32.728 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T11:19:32.729 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-42949672965 2026-02-17T11:19:32.729 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:19:32.730 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=42949672965 2026-02-17T11:19:32.730 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 42949672965' 2026-02-17T11:19:32.730 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.1 seq 42949672965 2026-02-17T11:19:32.730 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T11:19:32.941 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 42949672966 -lt 42949672965 2026-02-17T11:19:32.941 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:19:32.942 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-60129542147 2026-02-17T11:19:32.942 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:19:32.943 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:19:32.943 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-60129542147 2026-02-17T11:19:32.944 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:19:32.945 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=60129542147 2026-02-17T11:19:32.945 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 60129542147 2026-02-17T11:19:32.946 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 60129542147' 2026-02-17T11:19:32.946 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:19:33.152 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 60129542148 -lt 60129542147 2026-02-17T11:19:33.153 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:660: TEST_divergent_3: wait_for_clean 2026-02-17T11:19:33.153 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T11:19:33.153 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T11:19:33.153 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T11:19:33.153 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T11:19:33.154 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T11:19:33.154 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T11:19:33.154 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T11:19:33.154 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T11:19:33.155 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T11:19:33.257 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T11:19:33.257 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T11:19:33.257 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T11:19:33.257 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T11:19:33.257 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:19:33.257 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:19:33.461 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:19:33.461 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:19:33.461 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:19:33.461 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:19:33.462 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:19:33.462 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:19:33.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836489 2026-02-17T11:19:33.542 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836489 2026-02-17T11:19:33.542 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836489' 2026-02-17T11:19:33.542 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:19:33.542 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:19:33.622 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=42949672968 2026-02-17T11:19:33.622 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 42949672968 2026-02-17T11:19:33.622 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836489 1-42949672968' 2026-02-17T11:19:33.622 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:19:33.622 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:19:33.702 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=60129542150 2026-02-17T11:19:33.702 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 60129542150 2026-02-17T11:19:33.702 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836489 1-42949672968 2-60129542150' 2026-02-17T11:19:33.702 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:19:33.703 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836489 2026-02-17T11:19:33.703 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:19:33.704 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:19:33.704 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836489 2026-02-17T11:19:33.704 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:19:33.706 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836489 2026-02-17T11:19:33.706 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 21474836489 2026-02-17T11:19:33.707 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836489' 2026-02-17T11:19:33.707 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:19:33.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836490 -lt 21474836489 2026-02-17T11:19:33.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:19:33.921 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-42949672968 2026-02-17T11:19:33.921 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:19:33.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T11:19:33.922 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-42949672968 2026-02-17T11:19:33.923 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:19:33.924 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=42949672968 2026-02-17T11:19:33.924 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.1 seq 42949672968 2026-02-17T11:19:33.925 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 42949672968' 2026-02-17T11:19:33.925 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T11:19:34.129 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 42949672968 -lt 42949672968 2026-02-17T11:19:34.130 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:19:34.130 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-60129542150 2026-02-17T11:19:34.130 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:19:34.131 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:19:34.132 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-60129542150 2026-02-17T11:19:34.132 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:19:34.134 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=60129542150 2026-02-17T11:19:34.134 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 60129542150 2026-02-17T11:19:34.134 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 60129542150' 2026-02-17T11:19:34.134 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:19:34.345 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 60129542150 -lt 60129542150 2026-02-17T11:19:34.345 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T11:19:34.346 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:19:34.346 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:19:34.603 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 == 0 2026-02-17T11:19:34.603 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:19:34.603 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:19:34.603 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:19:34.603 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:19:34.603 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:19:34.604 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:19:34.604 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:19:34.798 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=1 2026-02-17T11:19:34.799 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:19:34.799 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:19:34.799 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:19:35.057 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 1 = 1 2026-02-17T11:19:35.057 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T11:19:35.057 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T11:19:35.057 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:663: TEST_divergent_3: ceph pg dump pgs --format=json 2026-02-17T11:19:35.057 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:663: TEST_divergent_3: jq '.pg_stats[0].up_primary' 2026-02-17T11:19:35.241 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:19:35.250 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:663: TEST_divergent_3: divergent=1 2026-02-17T11:19:35.250 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:664: TEST_divergent_3: echo 'primary and soon to be divergent is 1' 2026-02-17T11:19:35.250 INFO:tasks.workunit.client.0.trial148.stdout:primary and soon to be divergent is 1 2026-02-17T11:19:35.250 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: ceph pg dump pgs 2026-02-17T11:19:35.444 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:19:35.444 INFO:tasks.workunit.client.0.trial148.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T11:19:28.813043+0000 0'0 29:23 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T15:09:39.012443+0000 0 0 2026-02-17T11:19:35.445 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:19:35.445 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:19:35.445 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:19:35.453 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:667: TEST_divergent_3: date +%s 2026-02-17T11:19:35.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:667: TEST_divergent_3: current_time=1771327175 2026-02-17T11:19:35.454 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:668: TEST_divergent_3: expr 1771327175 - 1771327169 2026-02-17T11:19:35.456 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:668: TEST_divergent_3: elapsed_time=6 2026-02-17T11:19:35.456 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: '[' 6 -gt 300 ']' 2026-02-17T11:19:35.456 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:657: TEST_divergent_3: '[' 1 -le -1 ']' 2026-02-17T11:19:35.457 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:675: TEST_divergent_3: local non_divergent= 2026-02-17T11:19:35.457 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:676: TEST_divergent_3: for i in $osds 2026-02-17T11:19:35.457 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: '[' 0 = 1 ']' 2026-02-17T11:19:35.457 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:681: TEST_divergent_3: non_divergent=' 0' 2026-02-17T11:19:35.457 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:676: TEST_divergent_3: for i in $osds 2026-02-17T11:19:35.457 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: '[' 1 = 1 ']' 2026-02-17T11:19:35.457 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:679: TEST_divergent_3: continue 2026-02-17T11:19:35.457 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:676: TEST_divergent_3: for i in $osds 2026-02-17T11:19:35.457 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: '[' 2 = 1 ']' 2026-02-17T11:19:35.457 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:681: TEST_divergent_3: non_divergent=' 0 2' 2026-02-17T11:19:35.457 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:684: TEST_divergent_3: echo 'writing initial objects' 2026-02-17T11:19:35.458 INFO:tasks.workunit.client.0.trial148.stdout:writing initial objects 2026-02-17T11:19:35.458 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: seq 1 100 2026-02-17T11:19:35.458 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.458 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_1 /etc/fstab 2026-02-17T11:19:35.479 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.479 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_2 /etc/fstab 2026-02-17T11:19:35.509 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.509 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_3 /etc/fstab 2026-02-17T11:19:35.535 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_4 /etc/fstab 2026-02-17T11:19:35.561 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.561 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_5 /etc/fstab 2026-02-17T11:19:35.589 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.589 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_6 /etc/fstab 2026-02-17T11:19:35.616 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.617 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_7 /etc/fstab 2026-02-17T11:19:35.643 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.644 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_8 /etc/fstab 2026-02-17T11:19:35.671 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.672 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_9 /etc/fstab 2026-02-17T11:19:35.698 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.698 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_10 /etc/fstab 2026-02-17T11:19:35.726 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.726 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_11 /etc/fstab 2026-02-17T11:19:35.753 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.754 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_12 /etc/fstab 2026-02-17T11:19:35.782 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.782 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_13 /etc/fstab 2026-02-17T11:19:35.809 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.810 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_14 /etc/fstab 2026-02-17T11:19:35.830 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.830 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_15 /etc/fstab 2026-02-17T11:19:35.856 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.857 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_16 /etc/fstab 2026-02-17T11:19:35.883 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.883 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_17 /etc/fstab 2026-02-17T11:19:35.911 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.911 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_18 /etc/fstab 2026-02-17T11:19:35.940 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.940 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_19 /etc/fstab 2026-02-17T11:19:35.969 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.969 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_20 /etc/fstab 2026-02-17T11:19:35.997 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:35.997 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_21 /etc/fstab 2026-02-17T11:19:36.025 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.025 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_22 /etc/fstab 2026-02-17T11:19:36.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_23 /etc/fstab 2026-02-17T11:19:36.081 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.081 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_24 /etc/fstab 2026-02-17T11:19:36.109 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.109 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_25 /etc/fstab 2026-02-17T11:19:36.137 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.137 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_26 /etc/fstab 2026-02-17T11:19:36.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_27 /etc/fstab 2026-02-17T11:19:36.193 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.193 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_28 /etc/fstab 2026-02-17T11:19:36.221 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.221 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_29 /etc/fstab 2026-02-17T11:19:36.249 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.249 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_30 /etc/fstab 2026-02-17T11:19:36.269 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.269 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_31 /etc/fstab 2026-02-17T11:19:36.296 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.296 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_32 /etc/fstab 2026-02-17T11:19:36.317 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.317 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_33 /etc/fstab 2026-02-17T11:19:36.343 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.343 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_34 /etc/fstab 2026-02-17T11:19:36.370 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.370 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_35 /etc/fstab 2026-02-17T11:19:36.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_36 /etc/fstab 2026-02-17T11:19:36.425 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.425 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_37 /etc/fstab 2026-02-17T11:19:36.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_38 /etc/fstab 2026-02-17T11:19:36.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_39 /etc/fstab 2026-02-17T11:19:36.509 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.509 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_40 /etc/fstab 2026-02-17T11:19:36.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_41 /etc/fstab 2026-02-17T11:19:36.564 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.565 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_42 /etc/fstab 2026-02-17T11:19:36.592 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.592 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_43 /etc/fstab 2026-02-17T11:19:36.613 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.613 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_44 /etc/fstab 2026-02-17T11:19:36.640 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.640 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_45 /etc/fstab 2026-02-17T11:19:36.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.661 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_46 /etc/fstab 2026-02-17T11:19:36.687 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.687 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_47 /etc/fstab 2026-02-17T11:19:36.714 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.715 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_48 /etc/fstab 2026-02-17T11:19:36.743 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.743 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_49 /etc/fstab 2026-02-17T11:19:36.772 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.772 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_50 /etc/fstab 2026-02-17T11:19:36.800 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.800 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_51 /etc/fstab 2026-02-17T11:19:36.829 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.829 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_52 /etc/fstab 2026-02-17T11:19:36.857 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.858 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_53 /etc/fstab 2026-02-17T11:19:36.885 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.885 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_54 /etc/fstab 2026-02-17T11:19:36.912 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.912 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_55 /etc/fstab 2026-02-17T11:19:36.932 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.933 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_56 /etc/fstab 2026-02-17T11:19:36.959 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.959 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_57 /etc/fstab 2026-02-17T11:19:36.985 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:36.986 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_58 /etc/fstab 2026-02-17T11:19:37.013 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.013 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_59 /etc/fstab 2026-02-17T11:19:37.040 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.041 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_60 /etc/fstab 2026-02-17T11:19:37.068 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.069 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_61 /etc/fstab 2026-02-17T11:19:37.096 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.097 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_62 /etc/fstab 2026-02-17T11:19:37.118 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.118 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_63 /etc/fstab 2026-02-17T11:19:37.145 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.145 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_64 /etc/fstab 2026-02-17T11:19:37.171 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.171 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_65 /etc/fstab 2026-02-17T11:19:37.192 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.192 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_66 /etc/fstab 2026-02-17T11:19:37.213 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.214 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_67 /etc/fstab 2026-02-17T11:19:37.234 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.234 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_68 /etc/fstab 2026-02-17T11:19:37.260 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.261 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_69 /etc/fstab 2026-02-17T11:19:37.287 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.287 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_70 /etc/fstab 2026-02-17T11:19:37.315 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.315 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_71 /etc/fstab 2026-02-17T11:19:37.342 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.343 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_72 /etc/fstab 2026-02-17T11:19:37.370 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.370 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_73 /etc/fstab 2026-02-17T11:19:37.398 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.398 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_74 /etc/fstab 2026-02-17T11:19:37.425 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.425 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_75 /etc/fstab 2026-02-17T11:19:37.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.453 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_76 /etc/fstab 2026-02-17T11:19:37.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_77 /etc/fstab 2026-02-17T11:19:37.508 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.508 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_78 /etc/fstab 2026-02-17T11:19:37.528 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.528 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_79 /etc/fstab 2026-02-17T11:19:37.555 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.555 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_80 /etc/fstab 2026-02-17T11:19:37.581 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.582 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_81 /etc/fstab 2026-02-17T11:19:37.609 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.609 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_82 /etc/fstab 2026-02-17T11:19:37.636 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.637 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_83 /etc/fstab 2026-02-17T11:19:37.664 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.665 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_84 /etc/fstab 2026-02-17T11:19:37.693 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.693 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_85 /etc/fstab 2026-02-17T11:19:37.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_86 /etc/fstab 2026-02-17T11:19:37.749 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.749 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_87 /etc/fstab 2026-02-17T11:19:37.777 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.777 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_88 /etc/fstab 2026-02-17T11:19:37.805 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.805 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_89 /etc/fstab 2026-02-17T11:19:37.833 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.834 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_90 /etc/fstab 2026-02-17T11:19:37.861 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.861 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_91 /etc/fstab 2026-02-17T11:19:37.889 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.889 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_92 /etc/fstab 2026-02-17T11:19:37.917 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_93 /etc/fstab 2026-02-17T11:19:37.945 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.945 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_94 /etc/fstab 2026-02-17T11:19:37.973 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:37.973 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_95 /etc/fstab 2026-02-17T11:19:38.001 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:38.001 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_96 /etc/fstab 2026-02-17T11:19:38.029 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:38.029 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_97 /etc/fstab 2026-02-17T11:19:38.057 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:38.057 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_98 /etc/fstab 2026-02-17T11:19:38.085 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:38.085 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_99 /etc/fstab 2026-02-17T11:19:38.113 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-17T11:19:38.113 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: rados -p test put existing_100 /etc/fstab 2026-02-17T11:19:38.141 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:691: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T11:19:38.141 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:691: TEST_divergent_3: wait_for_clean 2026-02-17T11:19:38.141 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T11:19:38.141 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T11:19:38.141 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T11:19:38.142 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T11:19:38.142 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T11:19:38.142 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T11:19:38.142 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T11:19:38.143 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T11:19:38.143 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T11:19:38.215 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T11:19:38.215 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T11:19:38.215 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T11:19:38.215 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T11:19:38.215 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:19:38.215 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:19:38.420 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:19:38.420 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:19:38.420 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:19:38.420 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:19:38.420 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:19:38.420 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:19:38.501 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836492 2026-02-17T11:19:38.501 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836492 2026-02-17T11:19:38.501 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836492' 2026-02-17T11:19:38.501 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:19:38.502 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:19:38.578 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=42949672971 2026-02-17T11:19:38.578 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 42949672971 2026-02-17T11:19:38.578 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836492 1-42949672971' 2026-02-17T11:19:38.578 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:19:38.578 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:19:38.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=60129542153 2026-02-17T11:19:38.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 60129542153 2026-02-17T11:19:38.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836492 1-42949672971 2-60129542153' 2026-02-17T11:19:38.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:19:38.659 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836492 2026-02-17T11:19:38.660 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:19:38.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:19:38.661 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836492 2026-02-17T11:19:38.661 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:19:38.662 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836492 2026-02-17T11:19:38.663 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 21474836492 2026-02-17T11:19:38.663 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-17T11:19:38.663 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:19:38.881 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836490 -lt 21474836492 2026-02-17T11:19:38.881 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:19:39.881 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:19:39.882 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:19:40.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836493 -lt 21474836492 2026-02-17T11:19:40.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:19:40.084 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-42949672971 2026-02-17T11:19:40.085 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:19:40.086 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T11:19:40.086 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-42949672971 2026-02-17T11:19:40.087 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:19:40.088 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=42949672971 2026-02-17T11:19:40.088 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.1 seq 42949672971 2026-02-17T11:19:40.088 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 42949672971' 2026-02-17T11:19:40.089 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T11:19:40.299 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 42949672971 -lt 42949672971 2026-02-17T11:19:40.299 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:19:40.300 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-60129542153 2026-02-17T11:19:40.300 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:19:40.301 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:19:40.301 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-60129542153 2026-02-17T11:19:40.302 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:19:40.303 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=60129542153 2026-02-17T11:19:40.303 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 60129542153 2026-02-17T11:19:40.304 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 60129542153' 2026-02-17T11:19:40.304 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:19:40.512 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 60129542153 -lt 60129542153 2026-02-17T11:19:40.513 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T11:19:40.513 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:19:40.513 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:19:40.797 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 == 0 2026-02-17T11:19:40.797 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:19:40.798 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:19:40.798 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:19:40.798 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:19:40.798 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:19:40.798 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:19:40.798 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:19:40.998 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=1 2026-02-17T11:19:40.998 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:19:40.999 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:19:40.999 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:19:41.272 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 1 = 1 2026-02-17T11:19:41.272 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T11:19:41.272 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T11:19:41.272 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: get_pg test existing_1 2026-02-17T11:19:41.272 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1093: get_pg: local poolname=test 2026-02-17T11:19:41.272 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1094: get_pg: local objectname=existing_1 2026-02-17T11:19:41.272 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: ceph --format json osd map test existing_1 2026-02-17T11:19:41.272 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: jq -r .pgid 2026-02-17T11:19:41.473 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: local pgid=1.0 2026-02-17T11:19:41.473 INFO:tasks.workunit.client.0.trial148.stdout:blackholing osds 0 2 2026-02-17T11:19:41.474 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:696: TEST_divergent_3: echo 'blackholing osds 0 2' 2026-02-17T11:19:41.474 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:697: TEST_divergent_3: ceph pg dump pgs 2026-02-17T11:19:41.663 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:19:41.663 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 0 0 0 69500 0 0 16 84 16 active+clean 2026-02-17T11:19:28.813043+0000 29'100 29:123 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T15:09:39.012443+0000 0 0 2026-02-17T11:19:41.663 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:19:41.663 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:19:41.663 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:19:41.673 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:698: TEST_divergent_3: for i in $non_divergent 2026-02-17T11:19:41.674 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: get_asok_path osd.0 2026-02-17T11:19:41.674 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T11:19:41.674 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T11:19:41.674 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:19:41.675 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:19:41.675 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:19:41.675 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.0.asok 2026-02-17T11:19:41.675 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: CEPH_ARGS= 2026-02-17T11:19:41.675 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-17T11:19:41.739 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:19:41.739 INFO:tasks.workunit.client.0.trial148.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T11:19:41.739 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:19:41.745 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:698: TEST_divergent_3: for i in $non_divergent 2026-02-17T11:19:41.746 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: get_asok_path osd.2 2026-02-17T11:19:41.746 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2026-02-17T11:19:41.746 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2026-02-17T11:19:41.746 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:19:41.746 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:19:41.746 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:19:41.746 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.2.asok 2026-02-17T11:19:41.747 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: CEPH_ARGS= 2026-02-17T11:19:41.747 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-17T11:19:41.800 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:19:41.800 INFO:tasks.workunit.client.0.trial148.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T11:19:41.800 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:19:41.806 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:704: TEST_divergent_3: echo 'create new divergent objects' 2026-02-17T11:19:41.806 INFO:tasks.workunit.client.0.trial148.stdout:create new divergent objects 2026-02-17T11:19:41.807 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:705: TEST_divergent_3: seq 1 2 2026-02-17T11:19:41.807 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:705: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T11:19:41.808 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:705: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T11:19:41.808 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: rados -p test create newobject_1 2026-02-17T11:19:41.808 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:710: TEST_divergent_3: echo 'writing divergent objects' 2026-02-17T11:19:41.809 INFO:tasks.workunit.client.0.trial148.stdout:writing divergent objects 2026-02-17T11:19:41.810 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: rados -p test create newobject_2 2026-02-17T11:19:41.811 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:711: TEST_divergent_3: seq 1 2 2026-02-17T11:19:41.811 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:711: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-17T11:19:41.811 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:711: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-17T11:19:41.811 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: rados -p test put existing_1 /etc/resolv.conf 2026-02-17T11:19:41.811 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:716: TEST_divergent_3: echo 'remove divergent objects' 2026-02-17T11:19:41.812 INFO:tasks.workunit.client.0.trial148.stdout:remove divergent objects 2026-02-17T11:19:41.813 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: rados -p test put existing_2 /etc/resolv.conf 2026-02-17T11:19:41.814 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:717: TEST_divergent_3: seq 1 2 2026-02-17T11:19:41.814 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:717: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-17T11:19:41.814 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: expr 1 + 2 2026-02-17T11:19:41.814 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: rmi=3 2026-02-17T11:19:41.814 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:717: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-17T11:19:41.814 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:720: TEST_divergent_3: rados -p test rm existing_3 2026-02-17T11:19:41.816 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: expr 2 + 2 2026-02-17T11:19:41.816 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: rmi=4 2026-02-17T11:19:41.816 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: sleep 10 2026-02-17T11:19:41.816 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:720: TEST_divergent_3: rados -p test rm existing_4 2026-02-17T11:19:51.817 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:723: TEST_divergent_3: killall -9 rados 2026-02-17T11:19:51.859 INFO:tasks.workunit.client.0.trial148.stderr:rados: no process found 2026-02-17T11:19:51.859 INFO:tasks.workunit.client.0.trial148.stdout:killing all the osds 2026-02-17T11:19:51.860 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:726: TEST_divergent_3: echo 'killing all the osds' 2026-02-17T11:19:51.860 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:727: TEST_divergent_3: ceph pg dump pgs 2026-02-17T11:19:52.060 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:19:52.060 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 0 0 0 68654 0 0 16 90 16 active+clean 2026-02-17T11:19:28.813043+0000 29'106 29:129 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T15:09:39.012443+0000 0 0 2026-02-17T11:19:52.061 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:19:52.061 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:19:52.061 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:19:52.071 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:728: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd 2026-02-17T11:19:52.072 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:19:52.072 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:19:52.072 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:19:52.072 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:19:52.072 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:19:52.181 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:19:52.181 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:729: TEST_divergent_3: for i in $osds 2026-02-17T11:19:52.181 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: ceph osd down osd.0 2026-02-17T11:19:52.432 INFO:tasks.workunit.client.0.trial148.stderr:osd.0 is already down. 2026-02-17T11:19:52.441 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:729: TEST_divergent_3: for i in $osds 2026-02-17T11:19:52.441 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: ceph osd down osd.1 2026-02-17T11:19:52.704 INFO:tasks.workunit.client.0.trial148.stderr:osd.1 is already down. 2026-02-17T11:19:52.713 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:729: TEST_divergent_3: for i in $osds 2026-02-17T11:19:52.713 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: ceph osd down osd.2 2026-02-17T11:19:52.973 INFO:tasks.workunit.client.0.trial148.stderr:osd.2 is already down. 2026-02-17T11:19:52.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: for i in $non_divergent 2026-02-17T11:19:52.983 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: ceph osd out osd.0 2026-02-17T11:19:53.244 INFO:tasks.workunit.client.0.trial148.stderr:osd.0 is already out. 2026-02-17T11:19:53.253 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: for i in $non_divergent 2026-02-17T11:19:53.253 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: ceph osd out osd.2 2026-02-17T11:19:53.513 INFO:tasks.workunit.client.0.trial148.stderr:osd.2 is already out. 2026-02-17T11:19:53.522 INFO:tasks.workunit.client.0.trial148.stdout:bringing up non_divergent 0 2 2026-02-17T11:19:53.522 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:739: TEST_divergent_3: echo 'bringing up non_divergent 0 2' 2026-02-17T11:19:53.523 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:740: TEST_divergent_3: ceph pg dump pgs 2026-02-17T11:19:53.732 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:19:53.733 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 0 0 0 68654 0 0 16 90 16 stale+active+clean 2026-02-17T11:19:28.813043+0000 29'106 29:129 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T15:09:39.012443+0000 0 0 2026-02-17T11:19:53.733 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:19:53.733 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:19:53.733 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:19:53.746 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:741: TEST_divergent_3: for i in $non_divergent 2026-02-17T11:19:53.746 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: activate_osd td/divergent-priors 0 2026-02-17T11:19:53.746 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/divergent-priors 2026-02-17T11:19:53.746 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:19:53.746 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=0 2026-02-17T11:19:53.746 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:19:53.746 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T11:19:53.746 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:19:53.746 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:19:53.747 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:19:53.747 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:19:53.747 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T11:19:53.747 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T11:19:53.747 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:19:53.747 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:19:53.747 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:19:53.747 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:19:53.747 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:19:53.747 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:19:53.747 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:19:53.747 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:19:53.748 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:19:53.748 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:19:53.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:19:53.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:19:53.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:19:53.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:19:53.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:19:53.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:19:53.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:19:53.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:19:53.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:19:53.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:19:53.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T11:19:53.749 INFO:tasks.workunit.client.0.trial148.stdout:start osd.0 2026-02-17T11:19:53.750 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.0 2026-02-17T11:19:53.750 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 0 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:19:53.750 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T11:19:53.750 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 0 = 0 ']' 2026-02-17T11:19:53.750 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:19:53.751 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:19:53.751 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:19:53.775 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:53.768+0000 7f469b9d08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:53.776 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:53.772+0000 7f469b9d08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:53.777 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:53.772+0000 7f469b9d08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:53.958 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 0 2026-02-17T11:19:53.959 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:19:53.959 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T11:19:53.959 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:19:53.959 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:19:53.959 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:53.959 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:19:53.960 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:19:53.960 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:53.960 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:19:54.163 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:19:55.018 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:55.012+0000 7f469b9d08c0 -1 Falling back to public interface 2026-02-17T11:19:55.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:19:55.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:55.165 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:19:55.165 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:19:55.166 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:55.166 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:19:55.368 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:19:56.370 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:19:56.370 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:56.371 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:19:56.371 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:19:56.371 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:56.371 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:19:56.576 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:19:57.577 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:19:57.577 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:57.577 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:19:57.578 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:19:57.578 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:57.578 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:19:57.774 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:19:58.270 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:58.264+0000 7f469b9d08c0 -1 osd.0 29 log_to_monitors true 2026-02-17T11:19:58.776 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:19:58.776 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:58.776 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:19:58.776 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:19:58.777 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:58.777 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:19:58.975 INFO:tasks.workunit.client.0.trial148.stdout:osd.0 up out weight 0 up_from 36 up_thru 0 down_at 30 last_clean_interval [5,29) [v2:127.0.0.1:6802/3809649686,v1:127.0.0.1:6803/3809649686] [v2:127.0.0.1:6804/3809649686,v1:127.0.0.1:6805/3809649686] exists,up 445c6994-5669-4311-9e55-f2c103270e94 2026-02-17T11:19:58.979 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:19:58.979 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:19:58.979 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:19:58.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:741: TEST_divergent_3: for i in $non_divergent 2026-02-17T11:19:58.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: activate_osd td/divergent-priors 2 2026-02-17T11:19:58.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/divergent-priors 2026-02-17T11:19:58.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:19:58.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T11:19:58.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:19:58.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T11:19:58.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:19:58.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:19:58.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:19:58.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:19:58.981 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T11:19:58.981 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T11:19:58.981 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:19:58.981 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:19:58.981 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:19:58.981 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:19:58.981 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:19:58.981 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:19:58.981 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:19:58.981 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:19:58.981 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:19:58.981 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:19:58.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:19:58.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:19:58.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:19:58.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:19:58.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:19:58.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:19:58.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:19:58.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:19:58.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:19:58.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:19:58.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T11:19:58.983 INFO:tasks.workunit.client.0.trial148.stdout:start osd.2 2026-02-17T11:19:58.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T11:19:58.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:19:58.984 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T11:19:58.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T11:19:58.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:19:58.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:19:58.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:19:59.004 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:58.996+0000 7f345b0fe8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:59.006 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:59.000+0000 7f345b0fe8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:59.006 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:19:59.000+0000 7f345b0fe8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:19:59.182 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T11:19:59.182 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:19:59.182 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T11:19:59.182 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:19:59.183 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:19:59.183 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:19:59.183 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:19:59.183 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:19:59.184 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:19:59.184 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:19:59.383 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:20:00.266 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:20:00.259+0000 7f345b0fe8c0 -1 Falling back to public interface 2026-02-17T11:20:00.384 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:20:00.384 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:20:00.384 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:20:00.384 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:20:00.384 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:20:00.385 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:20:00.581 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:20:01.583 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:20:01.584 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:20:01.584 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:20:01.584 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:20:01.585 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:20:01.585 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:20:01.779 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:20:02.781 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:20:02.781 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:20:02.781 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:20:02.782 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:20:02.782 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:20:02.782 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:20:02.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:20:03.314 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:20:03.307+0000 7f345b0fe8c0 -1 osd.2 29 log_to_monitors true 2026-02-17T11:20:03.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:20:03.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:20:03.980 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:20:03.981 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:20:03.981 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:20:03.981 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:20:04.176 INFO:tasks.workunit.client.0.trial148.stdout:osd.2 up out weight 0 up_from 39 up_thru 0 down_at 32 last_clean_interval [14,29) [v2:127.0.0.1:6810/3194056430,v1:127.0.0.1:6811/3194056430] [v2:127.0.0.1:6812/3194056430,v1:127.0.0.1:6813/3194056430] exists,up 2dfcc774-bf64-4f70-a754-84bb2859cd23 2026-02-17T11:20:04.177 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:20:04.177 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:20:04.177 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:20:04.177 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: for i in $non_divergent 2026-02-17T11:20:04.177 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: ceph osd in osd.0 2026-02-17T11:20:04.424 INFO:tasks.workunit.client.0.trial148.stderr:osd.0 is already in. 2026-02-17T11:20:04.436 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: for i in $non_divergent 2026-02-17T11:20:04.437 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: ceph osd in osd.2 2026-02-17T11:20:04.686 INFO:tasks.workunit.client.0.trial148.stderr:osd.2 is already in. 2026-02-17T11:20:04.696 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:750: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T11:20:04.696 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:750: TEST_divergent_3: wait_for_clean 2026-02-17T11:20:04.696 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T11:20:04.696 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T11:20:04.696 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T11:20:04.697 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T11:20:04.697 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T11:20:04.697 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T11:20:04.698 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T11:20:04.698 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T11:20:04.698 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T11:20:04.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T11:20:04.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T11:20:04.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T11:20:04.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T11:20:04.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:20:04.759 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:20:04.966 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:20:04.966 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:20:04.966 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:20:04.966 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:20:04.967 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:20:04.967 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:20:05.050 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=154618822660 2026-02-17T11:20:05.050 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 154618822660 2026-02-17T11:20:05.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-154618822660' 2026-02-17T11:20:05.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:20:05.051 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:20:05.111 INFO:tasks.workunit.client.0.trial148.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-17T11:20:05.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq= 2026-02-17T11:20:05.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z '' 2026-02-17T11:20:05.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: continue 2026-02-17T11:20:05.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:20:05.115 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:20:05.190 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=167503724547 2026-02-17T11:20:05.190 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 167503724547 2026-02-17T11:20:05.190 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-154618822660 2-167503724547' 2026-02-17T11:20:05.190 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:20:05.191 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-154618822660 2026-02-17T11:20:05.191 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:20:05.192 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:20:05.193 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-154618822660 2026-02-17T11:20:05.193 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:20:05.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=154618822660 2026-02-17T11:20:05.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 154618822660' 2026-02-17T11:20:05.195 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 154618822660 2026-02-17T11:20:05.195 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:20:05.408 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 154618822657 -lt 154618822660 2026-02-17T11:20:05.408 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:20:06.408 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:20:06.409 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:20:06.612 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 154618822660 -lt 154618822660 2026-02-17T11:20:06.612 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:20:06.612 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-167503724547 2026-02-17T11:20:06.613 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:20:06.614 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:20:06.615 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-167503724547 2026-02-17T11:20:06.615 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:20:06.616 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=167503724547 2026-02-17T11:20:06.616 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 167503724547' 2026-02-17T11:20:06.617 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 167503724547 2026-02-17T11:20:06.617 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:20:06.832 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 167503724547 -lt 167503724547 2026-02-17T11:20:06.832 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T11:20:06.833 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:20:06.833 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:20:07.099 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 32 == 0 2026-02-17T11:20:07.099 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:20:07.100 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:20:07.100 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:20:07.100 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:20:07.100 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:20:07.100 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:20:07.101 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:20:07.307 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:20:07.308 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:20:07.308 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:20:07.308 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:20:07.578 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 32 2026-02-17T11:20:07.579 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' -1 2026-02-17T11:20:07.579 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: loop=0 2026-02-17T11:20:07.579 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: num_active_clean=0 2026-02-17T11:20:07.579 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:20:07.579 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.1 2026-02-17T11:20:07.679 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:20:07.679 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:20:07.680 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:20:07.681 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:20:07.681 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:20:07.681 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:20:07.681 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:20:07.681 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:20:07.884 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:20:07.885 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:20:07.885 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:20:07.885 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:20:08.149 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 32 2026-02-17T11:20:08.149 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:20:08.149 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:20:08.150 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:20:08.150 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:20:08.150 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:20:08.150 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:20:08.150 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:20:08.150 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:20:08.419 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:20:08.419 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:20:08.419 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 1 >= 8 )) 2026-02-17T11:20:08.419 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:20:08.419 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.2 2026-02-17T11:20:08.619 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:20:08.619 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:20:08.619 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:20:08.619 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:20:08.620 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:20:08.620 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:20:08.620 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:20:08.620 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:20:08.821 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:20:08.822 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:20:08.822 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:20:08.822 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:20:09.078 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 32 2026-02-17T11:20:09.078 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:20:09.078 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:20:09.078 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:20:09.078 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:20:09.078 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:20:09.078 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:20:09.079 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:20:09.079 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:20:09.336 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:20:09.337 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:20:09.337 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 2 >= 8 )) 2026-02-17T11:20:09.337 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:20:09.337 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.4 2026-02-17T11:20:09.738 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:20:09.738 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:20:09.738 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:20:09.738 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:20:09.738 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:20:09.738 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:20:09.739 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:20:09.739 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:20:09.935 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:20:09.935 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:20:09.936 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:20:09.936 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:20:10.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 32 2026-02-17T11:20:10.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:20:10.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:20:10.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:20:10.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:20:10.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:20:10.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:20:10.196 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:20:10.196 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:20:10.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:20:10.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:20:10.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 3 >= 8 )) 2026-02-17T11:20:10.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:20:10.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.8 2026-02-17T11:20:11.260 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:20:11.260 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:20:11.261 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:20:11.261 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:20:11.261 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:20:11.262 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:20:11.262 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:20:11.262 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:20:11.461 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:20:11.462 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:20:11.462 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:20:11.462 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:20:11.720 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 32 2026-02-17T11:20:11.720 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:20:11.720 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:20:11.720 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:20:11.720 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:20:11.720 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:20:11.720 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:20:11.721 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:20:11.721 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:20:11.977 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:20:11.977 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:20:11.977 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 4 >= 8 )) 2026-02-17T11:20:11.977 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:20:11.977 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 1.6 2026-02-17T11:20:13.579 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:20:13.579 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:20:13.580 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:20:13.580 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:20:13.580 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:20:13.581 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:20:13.581 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:20:13.581 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:20:13.779 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:20:13.780 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:20:13.780 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:20:13.780 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:20:14.042 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 32 2026-02-17T11:20:14.042 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:20:14.042 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:20:14.042 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:20:14.042 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:20:14.042 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:20:14.042 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:20:14.042 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:20:14.042 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:20:14.310 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:20:14.310 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:20:14.310 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 5 >= 8 )) 2026-02-17T11:20:14.310 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:20:14.310 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 3.2 2026-02-17T11:20:17.511 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:20:17.511 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:20:17.513 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:20:17.513 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:20:17.513 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:20:17.513 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:20:17.513 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:20:17.514 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:20:17.716 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:20:17.716 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:20:17.716 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:20:17.716 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:20:17.983 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 32 2026-02-17T11:20:17.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:20:17.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:20:17.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:20:17.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:20:17.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:20:17.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:20:17.984 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:20:17.984 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:20:18.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:20:18.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:20:18.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 6 >= 8 )) 2026-02-17T11:20:18.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:20:18.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 6.4 2026-02-17T11:20:24.651 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:20:24.651 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:20:24.652 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:20:24.653 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:20:24.653 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:20:24.653 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:20:24.653 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:20:24.653 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:20:24.855 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:20:24.856 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:20:24.856 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:20:24.857 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:20:25.125 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 32 2026-02-17T11:20:25.125 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:20:25.126 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:20:25.126 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:20:25.126 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:20:25.126 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:20:25.126 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:20:25.126 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:20:25.127 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:20:25.394 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:20:25.395 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:20:25.395 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 7 >= 8 )) 2026-02-17T11:20:25.395 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:20:25.395 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 7.3 2026-02-17T11:20:32.695 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:20:32.695 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:20:32.695 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:20:32.696 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:20:32.696 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:20:32.696 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:20:32.696 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:20:32.696 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:20:32.900 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:20:32.900 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:20:32.901 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:20:32.901 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:20:33.168 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 32 2026-02-17T11:20:33.168 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:20:33.168 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:20:33.168 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:20:33.168 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:20:33.168 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:20:33.168 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:20:33.169 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:20:33.169 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:20:33.439 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:20:33.439 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:20:33.439 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 8 >= 8 )) 2026-02-17T11:20:33.440 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1679: wait_for_clean: ceph report 2026-02-17T11:20:33.694 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:20:33.694 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_fingerprint": "19ca402e-29c1-4f28-8cde-571255c4b17d", 2026-02-17T11:20:33.694 INFO:tasks.workunit.client.0.trial148.stdout: "version": "19.2.3-705-g04cf6dd4", 2026-02-17T11:20:33.694 INFO:tasks.workunit.client.0.trial148.stdout: "commit": "04cf6dd4be446d06026adad18a5fbf5da1fa8c0e", 2026-02-17T11:20:33.694 INFO:tasks.workunit.client.0.trial148.stdout: "timestamp": "2026-02-17T11:20:33.691120+0000", 2026-02-17T11:20:33.694 INFO:tasks.workunit.client.0.trial148.stdout: "tag": "", 2026-02-17T11:20:33.695 INFO:tasks.workunit.client.0.trial148.stdout: "health": { 2026-02-17T11:20:33.695 INFO:tasks.workunit.client.0.trial148.stdout: "status": "HEALTH_WARN", 2026-02-17T11:20:33.695 INFO:tasks.workunit.client.0.trial148.stdout: "checks": { 2026-02-17T11:20:33.695 INFO:tasks.workunit.client.0.trial148.stdout: "OSDMAP_FLAGS": { 2026-02-17T11:20:33.695 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:20:33.695 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:20:33.695 INFO:tasks.workunit.client.0.trial148.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T11:20:33.695 INFO:tasks.workunit.client.0.trial148.stdout: "count": 17 2026-02-17T11:20:33.695 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.695 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [], 2026-02-17T11:20:33.695 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:20:33.696 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.696 INFO:tasks.workunit.client.0.trial148.stdout: "OSD_DOWN": { 2026-02-17T11:20:33.696 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:20:33.696 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:20:33.696 INFO:tasks.workunit.client.0.trial148.stdout: "message": "1 osds down", 2026-02-17T11:20:33.696 INFO:tasks.workunit.client.0.trial148.stdout: "count": 1 2026-02-17T11:20:33.696 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.696 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:20:33.696 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.696 INFO:tasks.workunit.client.0.trial148.stdout: "message": "osd.1 (root=default,host=trial148) is down" 2026-02-17T11:20:33.696 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.696 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:20:33.697 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:20:33.697 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.697 INFO:tasks.workunit.client.0.trial148.stdout: "PG_DEGRADED": { 2026-02-17T11:20:33.697 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:20:33.697 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:20:33.697 INFO:tasks.workunit.client.0.trial148.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-17T11:20:33.697 INFO:tasks.workunit.client.0.trial148.stdout: "count": 32 2026-02-17T11:20:33.697 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.697 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:20:33.697 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.697 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.697 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.698 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.698 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.698 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.698 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.698 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.698 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.698 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.698 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.698 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.698 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.698 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.698 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.698 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.699 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.699 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.699 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.699 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.699 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.699 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.699 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.699 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.699 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.699 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.699 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.699 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.699 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.700 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.700 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.700 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.700 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.700 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.700 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.700 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.700 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.700 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.700 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.700 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.700 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.701 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.701 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.701 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.701 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.701 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.701 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.701 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.701 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.701 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.701 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.701 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.701 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.701 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.702 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.702 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.702 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.702 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.702 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.702 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.702 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.702 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.702 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.702 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.702 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.702 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.703 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.703 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.703 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.703 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.703 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.703 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.703 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.703 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.703 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.703 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.703 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.703 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.704 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.704 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.704 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.704 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.704 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.704 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.704 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.704 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.704 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.704 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.704 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.704 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.704 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.705 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.705 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.705 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.705 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-17T11:20:33.705 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.705 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:20:33.705 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:20:33.705 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.705 INFO:tasks.workunit.client.0.trial148.stdout: "POOL_APP_NOT_ENABLED": { 2026-02-17T11:20:33.705 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:20:33.705 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:20:33.705 INFO:tasks.workunit.client.0.trial148.stdout: "message": "1 pool(s) do not have an application enabled", 2026-02-17T11:20:33.705 INFO:tasks.workunit.client.0.trial148.stdout: "count": 1 2026-02-17T11:20:33.706 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.706 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:20:33.706 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.706 INFO:tasks.workunit.client.0.trial148.stdout: "message": "application not enabled on pool 'test'" 2026-02-17T11:20:33.706 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.706 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.706 INFO:tasks.workunit.client.0.trial148.stdout: "message": "use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." 2026-02-17T11:20:33.706 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.706 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:20:33.706 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:20:33.706 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.706 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.707 INFO:tasks.workunit.client.0.trial148.stdout: "mutes": [] 2026-02-17T11:20:33.707 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.707 INFO:tasks.workunit.client.0.trial148.stdout: "monmap_first_committed": 1, 2026-02-17T11:20:33.707 INFO:tasks.workunit.client.0.trial148.stdout: "monmap_last_committed": 1, 2026-02-17T11:20:33.707 INFO:tasks.workunit.client.0.trial148.stdout: "monmap": { 2026-02-17T11:20:33.707 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 1, 2026-02-17T11:20:33.707 INFO:tasks.workunit.client.0.trial148.stdout: "fsid": "0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a", 2026-02-17T11:20:33.707 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:18:59.385810Z", 2026-02-17T11:20:33.707 INFO:tasks.workunit.client.0.trial148.stdout: "created": "2026-02-17T11:18:59.385810Z", 2026-02-17T11:20:33.707 INFO:tasks.workunit.client.0.trial148.stdout: "min_mon_release": 19, 2026-02-17T11:20:33.707 INFO:tasks.workunit.client.0.trial148.stdout: "min_mon_release_name": "squid", 2026-02-17T11:20:33.707 INFO:tasks.workunit.client.0.trial148.stdout: "election_strategy": 1, 2026-02-17T11:20:33.708 INFO:tasks.workunit.client.0.trial148.stdout: "disallowed_leaders": "", 2026-02-17T11:20:33.708 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode": false, 2026-02-17T11:20:33.708 INFO:tasks.workunit.client.0.trial148.stdout: "tiebreaker_mon": "", 2026-02-17T11:20:33.708 INFO:tasks.workunit.client.0.trial148.stdout: "removed_ranks": "", 2026-02-17T11:20:33.708 INFO:tasks.workunit.client.0.trial148.stdout: "features": { 2026-02-17T11:20:33.708 INFO:tasks.workunit.client.0.trial148.stdout: "persistent": [ 2026-02-17T11:20:33.708 INFO:tasks.workunit.client.0.trial148.stdout: "kraken", 2026-02-17T11:20:33.708 INFO:tasks.workunit.client.0.trial148.stdout: "luminous", 2026-02-17T11:20:33.708 INFO:tasks.workunit.client.0.trial148.stdout: "mimic", 2026-02-17T11:20:33.708 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap-prune", 2026-02-17T11:20:33.708 INFO:tasks.workunit.client.0.trial148.stdout: "nautilus", 2026-02-17T11:20:33.708 INFO:tasks.workunit.client.0.trial148.stdout: "octopus", 2026-02-17T11:20:33.708 INFO:tasks.workunit.client.0.trial148.stdout: "pacific", 2026-02-17T11:20:33.708 INFO:tasks.workunit.client.0.trial148.stdout: "elector-pinging", 2026-02-17T11:20:33.709 INFO:tasks.workunit.client.0.trial148.stdout: "quincy", 2026-02-17T11:20:33.709 INFO:tasks.workunit.client.0.trial148.stdout: "reef", 2026-02-17T11:20:33.709 INFO:tasks.workunit.client.0.trial148.stdout: "squid" 2026-02-17T11:20:33.709 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:20:33.709 INFO:tasks.workunit.client.0.trial148.stdout: "optional": [] 2026-02-17T11:20:33.709 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.709 INFO:tasks.workunit.client.0.trial148.stdout: "mons": [ 2026-02-17T11:20:33.709 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.709 INFO:tasks.workunit.client.0.trial148.stdout: "rank": 0, 2026-02-17T11:20:33.709 INFO:tasks.workunit.client.0.trial148.stdout: "name": "a", 2026-02-17T11:20:33.709 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:20:33.709 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:20:33.709 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.710 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:20:33.710 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:7115", 2026-02-17T11:20:33.710 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 0 2026-02-17T11:20:33.710 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.710 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.710 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.710 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T11:20:33.710 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T11:20:33.710 INFO:tasks.workunit.client.0.trial148.stdout: "priority": 0, 2026-02-17T11:20:33.710 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 0, 2026-02-17T11:20:33.710 INFO:tasks.workunit.client.0.trial148.stdout: "crush_location": "{}" 2026-02-17T11:20:33.710 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.711 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.711 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.711 INFO:tasks.workunit.client.0.trial148.stdout: "quorum": [ 2026-02-17T11:20:33.711 INFO:tasks.workunit.client.0.trial148.stdout: 0 2026-02-17T11:20:33.711 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:20:33.711 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap": { 2026-02-17T11:20:33.711 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 45, 2026-02-17T11:20:33.711 INFO:tasks.workunit.client.0.trial148.stdout: "fsid": "0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a", 2026-02-17T11:20:33.711 INFO:tasks.workunit.client.0.trial148.stdout: "created": "2026-02-17T11:18:59.471725+0000", 2026-02-17T11:20:33.711 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:20:04.732519+0000", 2026-02-17T11:20:33.711 INFO:tasks.workunit.client.0.trial148.stdout: "last_up_change": "2026-02-17T11:20:03.467160+0000", 2026-02-17T11:20:33.711 INFO:tasks.workunit.client.0.trial148.stdout: "last_in_change": "2026-02-17T11:20:04.629599+0000", 2026-02-17T11:20:33.712 INFO:tasks.workunit.client.0.trial148.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T11:20:33.712 INFO:tasks.workunit.client.0.trial148.stdout: "flags_num": 5800384, 2026-02-17T11:20:33.712 INFO:tasks.workunit.client.0.trial148.stdout: "flags_set": [ 2026-02-17T11:20:33.712 INFO:tasks.workunit.client.0.trial148.stdout: "nodown", 2026-02-17T11:20:33.712 INFO:tasks.workunit.client.0.trial148.stdout: "noin", 2026-02-17T11:20:33.712 INFO:tasks.workunit.client.0.trial148.stdout: "noout", 2026-02-17T11:20:33.712 INFO:tasks.workunit.client.0.trial148.stdout: "pglog_hardlimit", 2026-02-17T11:20:33.712 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snapdirs", 2026-02-17T11:20:33.712 INFO:tasks.workunit.client.0.trial148.stdout: "recovery_deletes", 2026-02-17T11:20:33.712 INFO:tasks.workunit.client.0.trial148.stdout: "sortbitwise" 2026-02-17T11:20:33.712 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:20:33.712 INFO:tasks.workunit.client.0.trial148.stdout: "crush_version": 9, 2026-02-17T11:20:33.713 INFO:tasks.workunit.client.0.trial148.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T11:20:33.713 INFO:tasks.workunit.client.0.trial148.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T11:20:33.713 INFO:tasks.workunit.client.0.trial148.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T11:20:33.713 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_snapshot": "", 2026-02-17T11:20:33.713 INFO:tasks.workunit.client.0.trial148.stdout: "pool_max": 1, 2026-02-17T11:20:33.713 INFO:tasks.workunit.client.0.trial148.stdout: "max_osd": 3, 2026-02-17T11:20:33.713 INFO:tasks.workunit.client.0.trial148.stdout: "require_min_compat_client": "luminous", 2026-02-17T11:20:33.713 INFO:tasks.workunit.client.0.trial148.stdout: "min_compat_client": "jewel", 2026-02-17T11:20:33.713 INFO:tasks.workunit.client.0.trial148.stdout: "require_osd_release": "squid", 2026-02-17T11:20:33.713 INFO:tasks.workunit.client.0.trial148.stdout: "allow_crimson": false, 2026-02-17T11:20:33.713 INFO:tasks.workunit.client.0.trial148.stdout: "pools": [ 2026-02-17T11:20:33.713 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.713 INFO:tasks.workunit.client.0.trial148.stdout: "pool": 1, 2026-02-17T11:20:33.714 INFO:tasks.workunit.client.0.trial148.stdout: "pool_name": "test", 2026-02-17T11:20:33.714 INFO:tasks.workunit.client.0.trial148.stdout: "create_time": "2026-02-17T11:19:27.640936+0000", 2026-02-17T11:20:33.714 INFO:tasks.workunit.client.0.trial148.stdout: "flags": 1, 2026-02-17T11:20:33.714 INFO:tasks.workunit.client.0.trial148.stdout: "flags_names": "hashpspool", 2026-02-17T11:20:33.714 INFO:tasks.workunit.client.0.trial148.stdout: "type": 1, 2026-02-17T11:20:33.714 INFO:tasks.workunit.client.0.trial148.stdout: "size": 3, 2026-02-17T11:20:33.714 INFO:tasks.workunit.client.0.trial148.stdout: "min_size": 2, 2026-02-17T11:20:33.714 INFO:tasks.workunit.client.0.trial148.stdout: "crush_rule": 0, 2026-02-17T11:20:33.714 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_count": 0, 2026-02-17T11:20:33.714 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_target": 0, 2026-02-17T11:20:33.714 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T11:20:33.714 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T11:20:33.714 INFO:tasks.workunit.client.0.trial148.stdout: "is_stretch_pool": false, 2026-02-17T11:20:33.715 INFO:tasks.workunit.client.0.trial148.stdout: "object_hash": 2, 2026-02-17T11:20:33.715 INFO:tasks.workunit.client.0.trial148.stdout: "pg_autoscale_mode": "on", 2026-02-17T11:20:33.715 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num": 32, 2026-02-17T11:20:33.715 INFO:tasks.workunit.client.0.trial148.stdout: "pg_placement_num": 1, 2026-02-17T11:20:33.715 INFO:tasks.workunit.client.0.trial148.stdout: "pg_placement_num_target": 32, 2026-02-17T11:20:33.715 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num_target": 32, 2026-02-17T11:20:33.715 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num_pending": 32, 2026-02-17T11:20:33.715 INFO:tasks.workunit.client.0.trial148.stdout: "last_pg_merge_meta": { 2026-02-17T11:20:33.715 INFO:tasks.workunit.client.0.trial148.stdout: "source_pgid": "0.0", 2026-02-17T11:20:33.715 INFO:tasks.workunit.client.0.trial148.stdout: "ready_epoch": 0, 2026-02-17T11:20:33.715 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_started": 0, 2026-02-17T11:20:33.715 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_clean": 0, 2026-02-17T11:20:33.715 INFO:tasks.workunit.client.0.trial148.stdout: "source_version": "0'0", 2026-02-17T11:20:33.716 INFO:tasks.workunit.client.0.trial148.stdout: "target_version": "0'0" 2026-02-17T11:20:33.716 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.716 INFO:tasks.workunit.client.0.trial148.stdout: "last_change": "40", 2026-02-17T11:20:33.716 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend": "0", 2026-02-17T11:20:33.716 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T11:20:33.716 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend_preluminous": "40", 2026-02-17T11:20:33.716 INFO:tasks.workunit.client.0.trial148.stdout: "auid": 0, 2026-02-17T11:20:33.716 INFO:tasks.workunit.client.0.trial148.stdout: "snap_mode": "selfmanaged", 2026-02-17T11:20:33.716 INFO:tasks.workunit.client.0.trial148.stdout: "snap_seq": 0, 2026-02-17T11:20:33.716 INFO:tasks.workunit.client.0.trial148.stdout: "snap_epoch": 0, 2026-02-17T11:20:33.716 INFO:tasks.workunit.client.0.trial148.stdout: "pool_snaps": [], 2026-02-17T11:20:33.716 INFO:tasks.workunit.client.0.trial148.stdout: "removed_snaps": "[]", 2026-02-17T11:20:33.716 INFO:tasks.workunit.client.0.trial148.stdout: "quota_max_bytes": 0, 2026-02-17T11:20:33.717 INFO:tasks.workunit.client.0.trial148.stdout: "quota_max_objects": 0, 2026-02-17T11:20:33.717 INFO:tasks.workunit.client.0.trial148.stdout: "tiers": [], 2026-02-17T11:20:33.717 INFO:tasks.workunit.client.0.trial148.stdout: "tier_of": -1, 2026-02-17T11:20:33.717 INFO:tasks.workunit.client.0.trial148.stdout: "read_tier": -1, 2026-02-17T11:20:33.717 INFO:tasks.workunit.client.0.trial148.stdout: "write_tier": -1, 2026-02-17T11:20:33.717 INFO:tasks.workunit.client.0.trial148.stdout: "cache_mode": "none", 2026-02-17T11:20:33.717 INFO:tasks.workunit.client.0.trial148.stdout: "target_max_bytes": 0, 2026-02-17T11:20:33.717 INFO:tasks.workunit.client.0.trial148.stdout: "target_max_objects": 0, 2026-02-17T11:20:33.717 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T11:20:33.717 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T11:20:33.717 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T11:20:33.717 INFO:tasks.workunit.client.0.trial148.stdout: "cache_min_flush_age": 0, 2026-02-17T11:20:33.717 INFO:tasks.workunit.client.0.trial148.stdout: "cache_min_evict_age": 0, 2026-02-17T11:20:33.717 INFO:tasks.workunit.client.0.trial148.stdout: "erasure_code_profile": "", 2026-02-17T11:20:33.718 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_params": { 2026-02-17T11:20:33.718 INFO:tasks.workunit.client.0.trial148.stdout: "type": "none" 2026-02-17T11:20:33.718 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.718 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_period": 0, 2026-02-17T11:20:33.718 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_count": 0, 2026-02-17T11:20:33.718 INFO:tasks.workunit.client.0.trial148.stdout: "use_gmt_hitset": true, 2026-02-17T11:20:33.718 INFO:tasks.workunit.client.0.trial148.stdout: "min_read_recency_for_promote": 0, 2026-02-17T11:20:33.718 INFO:tasks.workunit.client.0.trial148.stdout: "min_write_recency_for_promote": 0, 2026-02-17T11:20:33.718 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T11:20:33.718 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_search_last_n": 0, 2026-02-17T11:20:33.718 INFO:tasks.workunit.client.0.trial148.stdout: "grade_table": [], 2026-02-17T11:20:33.718 INFO:tasks.workunit.client.0.trial148.stdout: "stripe_width": 0, 2026-02-17T11:20:33.719 INFO:tasks.workunit.client.0.trial148.stdout: "expected_num_objects": 0, 2026-02-17T11:20:33.719 INFO:tasks.workunit.client.0.trial148.stdout: "fast_read": false, 2026-02-17T11:20:33.719 INFO:tasks.workunit.client.0.trial148.stdout: "options": {}, 2026-02-17T11:20:33.719 INFO:tasks.workunit.client.0.trial148.stdout: "application_metadata": {}, 2026-02-17T11:20:33.719 INFO:tasks.workunit.client.0.trial148.stdout: "read_balance": { 2026-02-17T11:20:33.719 INFO:tasks.workunit.client.0.trial148.stdout: "score_type": "Fair distribution", 2026-02-17T11:20:33.719 INFO:tasks.workunit.client.0.trial148.stdout: "score_acting": 2.9900000095367432, 2026-02-17T11:20:33.719 INFO:tasks.workunit.client.0.trial148.stdout: "score_stable": 2.9900000095367432, 2026-02-17T11:20:33.719 INFO:tasks.workunit.client.0.trial148.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T11:20:33.719 INFO:tasks.workunit.client.0.trial148.stdout: "raw_score_acting": 2, 2026-02-17T11:20:33.719 INFO:tasks.workunit.client.0.trial148.stdout: "raw_score_stable": 2, 2026-02-17T11:20:33.719 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity_weighted": 1, 2026-02-17T11:20:33.719 INFO:tasks.workunit.client.0.trial148.stdout: "average_primary_affinity": 1, 2026-02-17T11:20:33.720 INFO:tasks.workunit.client.0.trial148.stdout: "average_primary_affinity_weighted": 1 2026-02-17T11:20:33.720 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.720 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.720 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:20:33.720 INFO:tasks.workunit.client.0.trial148.stdout: "osds": [ 2026-02-17T11:20:33.720 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.720 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:20:33.720 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "445c6994-5669-4311-9e55-f2c103270e94", 2026-02-17T11:20:33.720 INFO:tasks.workunit.client.0.trial148.stdout: "up": 1, 2026-02-17T11:20:33.720 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:20:33.720 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:20:33.720 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:20:33.720 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 5, 2026-02-17T11:20:33.721 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 29, 2026-02-17T11:20:33.721 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 36, 2026-02-17T11:20:33.721 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 44, 2026-02-17T11:20:33.721 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 30, 2026-02-17T11:20:33.721 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:20:33.721 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:20:33.721 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:20:33.721 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.721 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:20:33.721 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6802", 2026-02-17T11:20:33.721 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3809649686 2026-02-17T11:20:33.721 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.721 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.721 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:20:33.722 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6803", 2026-02-17T11:20:33.722 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3809649686 2026-02-17T11:20:33.722 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.722 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.722 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.722 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:20:33.722 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:20:33.722 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.722 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:20:33.722 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6804", 2026-02-17T11:20:33.722 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3809649686 2026-02-17T11:20:33.723 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.723 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.723 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:20:33.723 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6805", 2026-02-17T11:20:33.723 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3809649686 2026-02-17T11:20:33.723 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.723 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.723 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.723 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:20:33.723 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:20:33.723 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.723 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:20:33.723 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6808", 2026-02-17T11:20:33.724 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3809649686 2026-02-17T11:20:33.724 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.724 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.724 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:20:33.724 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6809", 2026-02-17T11:20:33.724 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3809649686 2026-02-17T11:20:33.724 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.724 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.724 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.724 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:20:33.724 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:20:33.724 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.724 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:20:33.725 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6806", 2026-02-17T11:20:33.725 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3809649686 2026-02-17T11:20:33.725 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.725 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.725 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:20:33.725 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6807", 2026-02-17T11:20:33.725 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3809649686 2026-02-17T11:20:33.725 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.725 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.725 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.725 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6803/3809649686", 2026-02-17T11:20:33.725 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6805/3809649686", 2026-02-17T11:20:33.726 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6809/3809649686", 2026-02-17T11:20:33.726 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6807/3809649686", 2026-02-17T11:20:33.726 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:20:33.726 INFO:tasks.workunit.client.0.trial148.stdout: "exists", 2026-02-17T11:20:33.726 INFO:tasks.workunit.client.0.trial148.stdout: "up" 2026-02-17T11:20:33.726 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.726 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.726 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.726 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:20:33.726 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "2c40e141-b07b-4dad-aaf4-9c213ae159a3", 2026-02-17T11:20:33.726 INFO:tasks.workunit.client.0.trial148.stdout: "up": 0, 2026-02-17T11:20:33.726 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:20:33.726 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:20:33.726 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:20:33.727 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 0, 2026-02-17T11:20:33.727 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 0, 2026-02-17T11:20:33.727 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 10, 2026-02-17T11:20:33.727 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 21, 2026-02-17T11:20:33.727 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 31, 2026-02-17T11:20:33.727 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:20:33.727 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:20:33.727 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:20:33.727 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.727 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:20:33.727 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6810", 2026-02-17T11:20:33.727 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2601695318 2026-02-17T11:20:33.727 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.728 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.728 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:20:33.728 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6811", 2026-02-17T11:20:33.728 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2601695318 2026-02-17T11:20:33.728 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.728 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.728 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.728 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:20:33.728 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:20:33.728 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.728 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:20:33.728 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6812", 2026-02-17T11:20:33.728 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2601695318 2026-02-17T11:20:33.729 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.729 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.729 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:20:33.729 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6813", 2026-02-17T11:20:33.729 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2601695318 2026-02-17T11:20:33.729 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.729 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.729 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.729 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:20:33.729 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:20:33.729 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.729 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:20:33.729 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6816", 2026-02-17T11:20:33.730 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2601695318 2026-02-17T11:20:33.730 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.730 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.730 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:20:33.730 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6817", 2026-02-17T11:20:33.730 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2601695318 2026-02-17T11:20:33.730 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.730 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.730 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.730 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:20:33.730 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:20:33.730 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.730 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:20:33.731 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6814", 2026-02-17T11:20:33.731 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2601695318 2026-02-17T11:20:33.731 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.731 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.731 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:20:33.731 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6815", 2026-02-17T11:20:33.731 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2601695318 2026-02-17T11:20:33.731 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.731 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.731 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.731 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6811/2601695318", 2026-02-17T11:20:33.731 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6813/2601695318", 2026-02-17T11:20:33.731 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2601695318", 2026-02-17T11:20:33.731 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2601695318", 2026-02-17T11:20:33.731 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:20:33.732 INFO:tasks.workunit.client.0.trial148.stdout: "exists" 2026-02-17T11:20:33.732 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.732 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.732 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.732 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:20:33.732 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "2dfcc774-bf64-4f70-a754-84bb2859cd23", 2026-02-17T11:20:33.732 INFO:tasks.workunit.client.0.trial148.stdout: "up": 1, 2026-02-17T11:20:33.732 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:20:33.732 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:20:33.732 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:20:33.732 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 14, 2026-02-17T11:20:33.732 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 29, 2026-02-17T11:20:33.732 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 39, 2026-02-17T11:20:33.732 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 0, 2026-02-17T11:20:33.732 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 32, 2026-02-17T11:20:33.733 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:20:33.733 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:20:33.733 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:20:33.733 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.733 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:20:33.733 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6810", 2026-02-17T11:20:33.733 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3194056430 2026-02-17T11:20:33.733 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.733 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.733 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:20:33.733 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6811", 2026-02-17T11:20:33.733 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3194056430 2026-02-17T11:20:33.733 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.733 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.733 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.733 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:20:33.733 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:20:33.734 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.734 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:20:33.734 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6812", 2026-02-17T11:20:33.734 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3194056430 2026-02-17T11:20:33.734 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.734 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.734 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:20:33.734 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6813", 2026-02-17T11:20:33.734 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3194056430 2026-02-17T11:20:33.734 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.734 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.734 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.734 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:20:33.734 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:20:33.734 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.734 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:20:33.735 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6816", 2026-02-17T11:20:33.735 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3194056430 2026-02-17T11:20:33.735 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.735 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.735 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:20:33.735 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6817", 2026-02-17T11:20:33.735 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3194056430 2026-02-17T11:20:33.735 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.735 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.735 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.735 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:20:33.735 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:20:33.735 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.735 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:20:33.735 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6814", 2026-02-17T11:20:33.735 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3194056430 2026-02-17T11:20:33.736 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.736 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.736 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:20:33.736 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6815", 2026-02-17T11:20:33.736 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3194056430 2026-02-17T11:20:33.736 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.736 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.736 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.736 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6811/3194056430", 2026-02-17T11:20:33.736 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6813/3194056430", 2026-02-17T11:20:33.736 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3194056430", 2026-02-17T11:20:33.736 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3194056430", 2026-02-17T11:20:33.736 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:20:33.736 INFO:tasks.workunit.client.0.trial148.stdout: "exists", 2026-02-17T11:20:33.736 INFO:tasks.workunit.client.0.trial148.stdout: "up" 2026-02-17T11:20:33.736 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.737 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.737 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:20:33.737 INFO:tasks.workunit.client.0.trial148.stdout: "osd_xinfo": [ 2026-02-17T11:20:33.737 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.737 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:20:33.737 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:19:52.377976+0000", 2026-02-17T11:20:33.737 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:20:33.737 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:20:33.737 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:20:33.737 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:20:33.737 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "2026-02-17T11:19:08.517276+0000", 2026-02-17T11:20:33.737 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:20:33.737 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.737 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.737 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:20:33.737 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:19:52.649190+0000", 2026-02-17T11:20:33.738 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:20:33.738 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:20:33.738 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:20:33.738 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:20:33.738 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-17T11:20:33.738 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:20:33.738 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.738 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.738 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:20:33.738 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:19:52.919019+0000", 2026-02-17T11:20:33.738 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:20:33.738 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:20:33.738 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:20:33.738 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:20:33.738 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "2026-02-17T11:19:25.912537+0000", 2026-02-17T11:20:33.738 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:20:33.739 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.739 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:20:33.739 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap": [], 2026-02-17T11:20:33.739 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap_items": [], 2026-02-17T11:20:33.739 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap_primaries": [], 2026-02-17T11:20:33.739 INFO:tasks.workunit.client.0.trial148.stdout: "pg_temp": [], 2026-02-17T11:20:33.739 INFO:tasks.workunit.client.0.trial148.stdout: "primary_temp": [], 2026-02-17T11:20:33.739 INFO:tasks.workunit.client.0.trial148.stdout: "blocklist": {}, 2026-02-17T11:20:33.739 INFO:tasks.workunit.client.0.trial148.stdout: "range_blocklist": {}, 2026-02-17T11:20:33.739 INFO:tasks.workunit.client.0.trial148.stdout: "erasure_code_profiles": { 2026-02-17T11:20:33.739 INFO:tasks.workunit.client.0.trial148.stdout: "default": { 2026-02-17T11:20:33.739 INFO:tasks.workunit.client.0.trial148.stdout: "k": "2", 2026-02-17T11:20:33.739 INFO:tasks.workunit.client.0.trial148.stdout: "m": "2", 2026-02-17T11:20:33.739 INFO:tasks.workunit.client.0.trial148.stdout: "plugin": "jerasure", 2026-02-17T11:20:33.739 INFO:tasks.workunit.client.0.trial148.stdout: "technique": "reed_sol_van" 2026-02-17T11:20:33.739 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.739 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.740 INFO:tasks.workunit.client.0.trial148.stdout: "removed_snaps_queue": [], 2026-02-17T11:20:33.740 INFO:tasks.workunit.client.0.trial148.stdout: "new_removed_snaps": [], 2026-02-17T11:20:33.740 INFO:tasks.workunit.client.0.trial148.stdout: "new_purged_snaps": [], 2026-02-17T11:20:33.740 INFO:tasks.workunit.client.0.trial148.stdout: "crush_node_flags": {}, 2026-02-17T11:20:33.740 INFO:tasks.workunit.client.0.trial148.stdout: "device_class_flags": {}, 2026-02-17T11:20:33.740 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode": { 2026-02-17T11:20:33.740 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode_enabled": false, 2026-02-17T11:20:33.740 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_bucket_count": 0, 2026-02-17T11:20:33.740 INFO:tasks.workunit.client.0.trial148.stdout: "degraded_stretch_mode": 0, 2026-02-17T11:20:33.740 INFO:tasks.workunit.client.0.trial148.stdout: "recovering_stretch_mode": 0, 2026-02-17T11:20:33.740 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode_bucket": 0 2026-02-17T11:20:33.740 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.740 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.740 INFO:tasks.workunit.client.0.trial148.stdout: "osd_metadata": [ 2026-02-17T11:20:33.740 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.740 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:20:33.740 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:20:33.740 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6804/3809649686,v1:127.0.0.1:6805/3809649686]", 2026-02-17T11:20:33.741 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:20:33.741 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:20:33.741 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:20:33.741 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:20:33.741 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:20:33.741 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:20:33.741 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:20:33.741 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:20:33.741 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:20:33.741 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:20:33.741 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:20:33.741 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:20:33.741 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T11:20:33.741 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:20:33.741 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:20:33.741 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:20:33.741 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:20:33.741 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:20:33.742 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:20:33.742 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:20:33.742 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:20:33.742 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:20:33.742 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:20:33.742 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:19:02.118788Z", 2026-02-17T11:20:33.742 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:20:33.742 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:20:33.742 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:20:33.742 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:20:33.742 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:20:33.742 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:20:33.742 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:20:33.742 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6802/3809649686,v1:127.0.0.1:6803/3809649686]", 2026-02-17T11:20:33.742 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:20:33.742 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/3809649686,v1:127.0.0.1:6809/3809649686]", 2026-02-17T11:20:33.742 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/3809649686,v1:127.0.0.1:6807/3809649686]", 2026-02-17T11:20:33.742 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:20:33.742 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:20:33.743 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:20:33.743 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:20:33.743 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:20:33.743 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:20:33.743 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:20:33.743 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:20:33.743 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:20:33.743 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:20:33.743 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T11:20:33.743 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:20:33.743 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:20:33.743 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:20:33.743 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.743 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.743 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:20:33.743 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:20:33.743 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6812/2601695318,v1:127.0.0.1:6813/2601695318]", 2026-02-17T11:20:33.743 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:20:33.743 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:20:33.744 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:19:10.125329Z", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6810/2601695318,v1:127.0.0.1:6811/2601695318]", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2601695318,v1:127.0.0.1:6817/2601695318]", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2601695318,v1:127.0.0.1:6815/2601695318]", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:20:33.745 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6812/3194056430,v1:127.0.0.1:6813/3194056430]", 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:20:33.746 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:19:19.338643Z", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:20:33.747 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6810/3194056430,v1:127.0.0.1:6811/3194056430]", 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3194056430,v1:127.0.0.1:6817/3194056430]", 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3194056430,v1:127.0.0.1:6815/3194056430]", 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_clean_epochs": { 2026-02-17T11:20:33.748 INFO:tasks.workunit.client.0.trial148.stdout: "min_last_epoch_clean": 0, 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_clean": { 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: "per_pool": [] 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: "osd_epochs": [ 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 36 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 40 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_first_committed": 1, 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_last_committed": 45, 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: "crushmap": { 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: "devices": [ 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.0", 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:20:33.749 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.1", 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.2", 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: "types": [ 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 0, 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd" 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: "name": "host" 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 2, 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: "name": "chassis" 2026-02-17T11:20:33.750 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.751 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.751 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 3, 2026-02-17T11:20:33.751 INFO:tasks.workunit.client.0.trial148.stdout: "name": "rack" 2026-02-17T11:20:33.751 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.751 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.751 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 4, 2026-02-17T11:20:33.751 INFO:tasks.workunit.client.0.trial148.stdout: "name": "row" 2026-02-17T11:20:33.751 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.751 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.751 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 5, 2026-02-17T11:20:33.751 INFO:tasks.workunit.client.0.trial148.stdout: "name": "pdu" 2026-02-17T11:20:33.751 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.751 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.751 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 6, 2026-02-17T11:20:33.751 INFO:tasks.workunit.client.0.trial148.stdout: "name": "pod" 2026-02-17T11:20:33.751 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.751 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.751 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 7, 2026-02-17T11:20:33.751 INFO:tasks.workunit.client.0.trial148.stdout: "name": "room" 2026-02-17T11:20:33.752 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.752 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.752 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 8, 2026-02-17T11:20:33.752 INFO:tasks.workunit.client.0.trial148.stdout: "name": "datacenter" 2026-02-17T11:20:33.752 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.752 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.752 INFO:tasks.workunit.client.0.trial148.stderr:report 2081480832 2026-02-17T11:20:33.752 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 9, 2026-02-17T11:20:33.752 INFO:tasks.workunit.client.0.trial148.stdout: "name": "zone" 2026-02-17T11:20:33.752 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 10, 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: "name": "region" 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: "name": "root" 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: "buckets": [ 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: "id": -1, 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: "name": "default", 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "root", 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: "id": -3, 2026-02-17T11:20:33.753 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: "id": -2, 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: "name": "default~ssd", 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "root", 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: "id": -4, 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: "id": -3, 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: "name": "trial148", 2026-02-17T11:20:33.754 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "host", 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 1 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 2 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: "id": -4, 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: "name": "trial148~ssd", 2026-02-17T11:20:33.755 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "host", 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 1 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 2 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: "rules": [ 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.756 INFO:tasks.workunit.client.0.trial148.stdout: "rule_id": 0, 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: "rule_name": "replicated_rule", 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: "type": 1, 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: "steps": [ 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: "op": "take", 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: "item": -1, 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: "item_name": "default" 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: "op": "choose_firstn", 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: "num": 0, 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: "type": "osd" 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: "op": "emit" 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: "tunables": { 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: "choose_local_tries": 0, 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: "choose_local_fallback_tries": 0, 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: "choose_total_tries": 50, 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_descend_once": 1, 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_vary_r": 1, 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_stable": 1, 2026-02-17T11:20:33.757 INFO:tasks.workunit.client.0.trial148.stdout: "msr_descents": 100, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "msr_collision_tries": 100, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "straw_calc_version": 1, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "allowed_bucket_algs": 54, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "profile": "jewel", 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "optimal_tunables": 1, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "legacy_tunables": 0, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "minimum_required_version": "jewel", 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables": 1, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables2": 1, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "has_v2_rules": 0, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables3": 1, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "has_v3_rules": 0, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "has_v4_buckets": 1, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables5": 1, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "has_v5_rules": 0, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "has_msr_rules": 0 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "choose_args": {} 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "fsmap": { 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 1, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "btime": "2026-02-17T11:18:59:471505+0000", 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "default_fscid": -1, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "compat": { 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "compat": {}, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "ro_compat": {}, 2026-02-17T11:20:33.758 INFO:tasks.workunit.client.0.trial148.stdout: "incompat": { 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "feature_1": "base v0.20", 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "feature_2": "client writeable ranges", 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "feature_4": "dir inode in separate object", 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "feature_8": "no anchor table", 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "feature_9": "file layout v2", 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "feature_10": "snaprealm v2", 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "feature_11": "minor log segments", 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "feature_flags": { 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "enable_multiple": true, 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "ever_enabled_multiple": true 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "standbys": [], 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "filesystems": [] 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "mdsmap_first_committed": 1, 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "mdsmap_last_committed": 1, 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "auth": { 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "first_committed": 1, 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "last_committed": 5, 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "num_secrets": 3 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.759 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg": 32, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_active": 32, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_unknown": 0, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_osd": 3, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "pool_sum": { 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "stat_sum": { 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes": 69500, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects": 100, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_clones": 0, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_copies": 300, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing": 0, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_degraded": 100, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_misplaced": 0, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_unfound": 0, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_dirty": 100, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_whiteouts": 0, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_read": 0, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_read_kb": 0, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_write": 100, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_write_kb": 100, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_scrub_errors": 0, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_deep_scrub_errors": 0, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_recovered": 0, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_recovered": 0, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_keys_recovered": 0, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_omap": 0, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T11:20:33.760 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_kb": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_kb": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "num_promote": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_high": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_low": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_some": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_full": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_pinned": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "num_legacy_snapsets": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "num_large_omap_objects": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_manifest": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_bytes": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_keys": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_repaired": 0 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "store_stats": { 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "total": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "available": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 0, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 0 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.761 INFO:tasks.workunit.client.0.trial148.stdout: "log_size": 512, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "ondisk_log_size": 512, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "up": 64, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "acting": 64, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "num_store_stats": 0 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "osd_sum": { 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 0, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 0, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "num_pgs": 65, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "num_osds": 3, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_osds": 3, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "kb": 314572800, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used": 84004, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_data": 2168, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_omap": 10, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_meta": 81717, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "kb_avail": 314488796, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "statfs": { 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "total": 322122547200, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "available": 322036527104, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 2220032, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 517845, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 10389, 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 83679083 2026-02-17T11:20:33.762 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "hb_peers": [], 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "snap_trim_queue_len": 0, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "num_snap_trimming": 0, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "num_shards_repaired": 0, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "op_queue_age_hist": { 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "histogram": [], 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "upper_bound": 1 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "perf_stat": { 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ms": 0, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ms": 0, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ns": 0, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ns": 0 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "alerts": [], 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "network_ping_times": [] 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "osd_sum_by_class": { 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "ssd": { 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 0, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 0, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "num_pgs": 65, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "num_osds": 3, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_osds": 3, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "kb": 314572800, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used": 84004, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_data": 2168, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_omap": 10, 2026-02-17T11:20:33.763 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_meta": 81717, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "kb_avail": 314488796, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "statfs": { 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "total": 322122547200, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "available": 322036527104, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 2220032, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 517845, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 10389, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 83679083 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "hb_peers": [], 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "snap_trim_queue_len": 0, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "num_snap_trimming": 0, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "num_shards_repaired": 0, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "op_queue_age_hist": { 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "histogram": [], 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "upper_bound": 1 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "perf_stat": { 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ms": 0, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ms": 0, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ns": 0, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ns": 0 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "alerts": [], 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "network_ping_times": [] 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.764 INFO:tasks.workunit.client.0.trial148.stdout: "pool_stats": [ 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "poolid": 1, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg": 32, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "stat_sum": { 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes": 69500, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects": 100, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_clones": 0, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_copies": 300, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing": 0, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_degraded": 100, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_misplaced": 0, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_unfound": 0, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_dirty": 100, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_whiteouts": 0, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_read": 0, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_read_kb": 0, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_write": 100, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_write_kb": 100, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_scrub_errors": 0, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_deep_scrub_errors": 0, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_recovered": 0, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_recovered": 0, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_keys_recovered": 0, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_omap": 0, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush": 0, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_kb": 0, 2026-02-17T11:20:33.765 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_kb": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "num_promote": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_high": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_low": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_some": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_full": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_pinned": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "num_legacy_snapsets": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "num_large_omap_objects": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_manifest": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_bytes": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_keys": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_repaired": 0 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "store_stats": { 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "total": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "available": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 1220608, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 207654, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 0, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 0 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "log_size": 512, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "ondisk_log_size": 512, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "up": 64, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "acting": 64, 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: "num_store_stats": 3 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.766 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: "osd_stats": [ 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 154618822665 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 42949672974 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 167503724552 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_by_state": [ 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: "state": "active+undersized+degraded", 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: "num": 32 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_by_osd": [ 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 0, 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 32, 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 32, 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 32, 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:20:33.767 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 0, 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 0, 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snaps": [ 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "pool": 1, 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snaps": {} 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "servicemap": { 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 4, 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:20:17.852282+0000", 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "services": { 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "osd": { 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "daemons": { 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "summary": "", 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "0": { 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "start_epoch": 0, 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "start_stamp": "0.000000", 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "gid": 0, 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "metadata": {}, 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "task_status": {} 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "2": { 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "start_epoch": 0, 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "start_stamp": "0.000000", 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "gid": 0, 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T11:20:33.768 INFO:tasks.workunit.client.0.trial148.stdout: "metadata": {}, 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stdout: "task_status": {} 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stdout: "mgrstat_first_committed": 1, 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stdout: "mgrstat_last_committed": 44, 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stdout: "logm_first_committed": 1, 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stdout: "logm_last_committed": 236, 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stdout: "paxos": { 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stdout: "first_committed": 1, 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stdout: "last_committed": 335, 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stdout: "last_pn": 0, 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stdout: "accepted_pn": 0 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1680: wait_for_clean: return 1 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:753: TEST_divergent_3: expr 2 + 2 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:753: TEST_divergent_3: objname=existing_4 2026-02-17T11:20:33.769 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:754: TEST_divergent_3: echo 'writing non-divergent object existing_4' 2026-02-17T11:20:33.770 INFO:tasks.workunit.client.0.trial148.stdout:writing non-divergent object existing_4 2026-02-17T11:20:33.770 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: ceph pg dump pgs 2026-02-17T11:20:33.895 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:20:33.896 INFO:tasks.workunit.client.0.trial148.stdout:1.1f 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535289+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444687+0000 0 0 2026-02-17T11:20:33.896 INFO:tasks.workunit.client.0.trial148.stdout:1.1e 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535158+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444634+0000 0 0 2026-02-17T11:20:33.896 INFO:tasks.workunit.client.0.trial148.stdout:1.1d 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534901+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444484+0000 0 0 2026-02-17T11:20:33.896 INFO:tasks.workunit.client.0.trial148.stdout:1.b 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533702+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444624+0000 0 0 2026-02-17T11:20:33.896 INFO:tasks.workunit.client.0.trial148.stdout:1.a 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533669+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444651+0000 0 0 2026-02-17T11:20:33.896 INFO:tasks.workunit.client.0.trial148.stdout:1.9 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533725+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444570+0000 0 0 2026-02-17T11:20:33.896 INFO:tasks.workunit.client.0.trial148.stdout:1.8 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533667+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444579+0000 0 0 2026-02-17T11:20:33.896 INFO:tasks.workunit.client.0.trial148.stdout:1.7 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535004+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444724+0000 0 0 2026-02-17T11:20:33.896 INFO:tasks.workunit.client.0.trial148.stdout:1.6 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534716+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444705+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.5 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533622+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444597+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.4 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533612+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444669+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.3 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533558+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444642+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.2 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533725+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444615+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.c 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534661+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444606+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.1 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533554+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444661+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.1c 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535631+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444514+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.0 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533565+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444440+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.d 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534577+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444588+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.e 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535266+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444733+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.f 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534748+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444714+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.10 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535287+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444465+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.11 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534806+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444474+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.12 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534552+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444533+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.13 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534803+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444524+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.14 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534893+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444561+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.15 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535164+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444504+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.16 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534654+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444678+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.17 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534595+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444696+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.18 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534668+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444552+0000 0 0 2026-02-17T11:20:33.897 INFO:tasks.workunit.client.0.trial148.stdout:1.19 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535057+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444453+0000 0 0 2026-02-17T11:20:33.898 INFO:tasks.workunit.client.0.trial148.stdout:1.1a 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534988+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444493+0000 0 0 2026-02-17T11:20:33.898 INFO:tasks.workunit.client.0.trial148.stdout:1.1b 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534754+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444542+0000 0 0 2026-02-17T11:20:33.898 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:20:33.898 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:20:33.898 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:20:33.904 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:756: TEST_divergent_3: rados -p test put existing_4 /etc/resolv.conf 2026-02-17T11:20:33.927 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:758: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T11:20:33.927 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:758: TEST_divergent_3: wait_for_clean 2026-02-17T11:20:33.927 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T11:20:33.927 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T11:20:33.927 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T11:20:33.927 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T11:20:33.928 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T11:20:33.928 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T11:20:33.928 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T11:20:33.929 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T11:20:33.929 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T11:20:34.001 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T11:20:34.001 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T11:20:34.001 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T11:20:34.001 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T11:20:34.001 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:20:34.001 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:20:34.202 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:20:34.202 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:20:34.202 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:20:34.202 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:20:34.202 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:20:34.202 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:20:34.283 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=154618822667 2026-02-17T11:20:34.283 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 154618822667 2026-02-17T11:20:34.283 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-154618822667' 2026-02-17T11:20:34.283 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:20:34.284 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:20:34.342 INFO:tasks.workunit.client.0.trial148.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-17T11:20:34.345 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq= 2026-02-17T11:20:34.345 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z '' 2026-02-17T11:20:34.345 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: continue 2026-02-17T11:20:34.345 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:20:34.345 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:20:34.422 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=167503724555 2026-02-17T11:20:34.422 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 167503724555 2026-02-17T11:20:34.422 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-154618822667 2-167503724555' 2026-02-17T11:20:34.422 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:20:34.423 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-154618822667 2026-02-17T11:20:34.423 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:20:34.423 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:20:34.424 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-154618822667 2026-02-17T11:20:34.424 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:20:34.426 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=154618822667 2026-02-17T11:20:34.426 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 154618822667 2026-02-17T11:20:34.427 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 154618822667' 2026-02-17T11:20:34.427 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:20:34.638 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 154618822665 -lt 154618822667 2026-02-17T11:20:34.639 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:20:35.639 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:20:35.640 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:20:35.843 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 154618822665 -lt 154618822667 2026-02-17T11:20:35.844 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:20:36.845 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T11:20:36.845 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:20:37.049 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 154618822668 -lt 154618822667 2026-02-17T11:20:37.049 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:20:37.050 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-167503724555 2026-02-17T11:20:37.050 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:20:37.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:20:37.052 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-167503724555 2026-02-17T11:20:37.052 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:20:37.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=167503724555 2026-02-17T11:20:37.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 167503724555' 2026-02-17T11:20:37.053 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 167503724555 2026-02-17T11:20:37.053 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:20:37.264 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 167503724555 -lt 167503724555 2026-02-17T11:20:37.265 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T11:20:37.265 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:20:37.265 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:20:37.537 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 32 == 0 2026-02-17T11:20:37.538 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:20:37.538 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:20:37.538 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:20:37.538 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:20:37.538 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:20:37.538 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:20:37.538 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:20:37.744 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:20:37.745 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:20:37.745 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:20:37.745 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:20:38.010 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 32 2026-02-17T11:20:38.010 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' -1 2026-02-17T11:20:38.010 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: loop=0 2026-02-17T11:20:38.010 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: num_active_clean=0 2026-02-17T11:20:38.011 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:20:38.011 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.1 2026-02-17T11:20:38.112 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:20:38.112 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:20:38.112 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:20:38.112 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:20:38.112 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:20:38.112 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:20:38.112 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:20:38.113 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:20:38.316 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:20:38.317 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:20:38.317 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:20:38.317 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:20:38.588 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 32 2026-02-17T11:20:38.588 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:20:38.588 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:20:38.588 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:20:38.588 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:20:38.588 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:20:38.588 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:20:38.589 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:20:38.589 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:20:38.857 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:20:38.857 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:20:38.857 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 1 >= 8 )) 2026-02-17T11:20:38.857 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:20:38.857 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.2 2026-02-17T11:20:39.057 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:20:39.058 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:20:39.059 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:20:39.059 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:20:39.059 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:20:39.059 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:20:39.059 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:20:39.059 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:20:39.265 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:20:39.265 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:20:39.266 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:20:39.266 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:20:39.537 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 32 2026-02-17T11:20:39.538 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:20:39.538 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:20:39.538 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:20:39.538 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:20:39.538 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:20:39.538 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:20:39.538 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:20:39.538 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:20:39.803 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:20:39.803 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:20:39.803 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 2 >= 8 )) 2026-02-17T11:20:39.803 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:20:39.803 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.4 2026-02-17T11:20:40.203 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:20:40.203 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:20:40.204 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:20:40.204 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:20:40.204 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:20:40.204 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:20:40.204 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:20:40.205 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:20:40.407 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:20:40.407 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:20:40.408 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:20:40.408 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:20:40.664 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 32 2026-02-17T11:20:40.664 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:20:40.664 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:20:40.665 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:20:40.665 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:20:40.665 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:20:40.665 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:20:40.665 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:20:40.665 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:20:40.925 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:20:40.925 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:20:40.926 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 3 >= 8 )) 2026-02-17T11:20:40.926 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:20:40.926 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.8 2026-02-17T11:20:41.726 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:20:41.726 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:20:41.727 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:20:41.727 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:20:41.728 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:20:41.728 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:20:41.728 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:20:41.728 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:20:41.929 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:20:41.930 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:20:41.930 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:20:41.930 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:20:42.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 32 2026-02-17T11:20:42.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:20:42.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:20:42.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:20:42.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:20:42.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:20:42.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:20:42.188 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:20:42.189 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:20:42.448 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:20:42.448 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:20:42.448 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 4 >= 8 )) 2026-02-17T11:20:42.449 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:20:42.449 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 1.6 2026-02-17T11:20:44.049 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:20:44.049 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:20:44.050 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:20:44.050 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:20:44.050 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:20:44.050 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:20:44.051 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:20:44.051 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:20:44.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:20:44.252 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:20:44.252 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:20:44.252 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:20:44.511 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 32 2026-02-17T11:20:44.511 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:20:44.511 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:20:44.511 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:20:44.511 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:20:44.511 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:20:44.511 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:20:44.512 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:20:44.512 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:20:44.769 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:20:44.770 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:20:44.770 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 5 >= 8 )) 2026-02-17T11:20:44.770 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:20:44.770 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 3.2 2026-02-17T11:20:47.970 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:20:47.971 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:20:47.972 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:20:47.972 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:20:47.972 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:20:47.972 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:20:47.972 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:20:47.972 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:20:48.170 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:20:48.170 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:20:48.171 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:20:48.171 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:20:48.433 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 32 2026-02-17T11:20:48.433 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:20:48.433 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:20:48.433 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:20:48.434 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:20:48.434 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:20:48.434 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:20:48.434 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:20:48.434 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:20:48.694 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:20:48.694 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:20:48.694 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 6 >= 8 )) 2026-02-17T11:20:48.694 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:20:48.695 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 6.4 2026-02-17T11:20:55.095 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:20:55.095 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:20:55.096 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:20:55.097 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:20:55.097 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:20:55.097 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:20:55.097 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:20:55.097 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:20:55.294 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:20:55.295 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:20:55.295 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:20:55.295 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:20:55.552 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 32 2026-02-17T11:20:55.552 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:20:55.552 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:20:55.552 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:20:55.552 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:20:55.552 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:20:55.552 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:20:55.552 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:20:55.553 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:20:55.809 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:20:55.809 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:20:55.809 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 7 >= 8 )) 2026-02-17T11:20:55.809 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:20:55.809 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 7.3 2026-02-17T11:21:03.110 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:21:03.110 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:21:03.112 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:21:03.112 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:21:03.112 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:21:03.112 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:21:03.112 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:21:03.113 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:21:03.309 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:21:03.310 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:21:03.310 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:21:03.310 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:21:03.567 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 32 2026-02-17T11:21:03.567 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:21:03.567 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:21:03.567 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:21:03.567 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:21:03.567 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:21:03.567 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:21:03.568 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:21:03.568 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:21:03.825 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:21:03.825 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:21:03.825 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 8 >= 8 )) 2026-02-17T11:21:03.825 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1679: wait_for_clean: ceph report 2026-02-17T11:21:04.081 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:21:04.081 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_fingerprint": "19ca402e-29c1-4f28-8cde-571255c4b17d", 2026-02-17T11:21:04.081 INFO:tasks.workunit.client.0.trial148.stdout: "version": "19.2.3-705-g04cf6dd4", 2026-02-17T11:21:04.081 INFO:tasks.workunit.client.0.trial148.stdout: "commit": "04cf6dd4be446d06026adad18a5fbf5da1fa8c0e", 2026-02-17T11:21:04.082 INFO:tasks.workunit.client.0.trial148.stdout: "timestamp": "2026-02-17T11:21:04.078102+0000", 2026-02-17T11:21:04.082 INFO:tasks.workunit.client.0.trial148.stdout: "tag": "", 2026-02-17T11:21:04.082 INFO:tasks.workunit.client.0.trial148.stdout: "health": { 2026-02-17T11:21:04.082 INFO:tasks.workunit.client.0.trial148.stdout: "status": "HEALTH_WARN", 2026-02-17T11:21:04.082 INFO:tasks.workunit.client.0.trial148.stdout: "checks": { 2026-02-17T11:21:04.082 INFO:tasks.workunit.client.0.trial148.stdout: "OSDMAP_FLAGS": { 2026-02-17T11:21:04.082 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:21:04.082 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:21:04.082 INFO:tasks.workunit.client.0.trial148.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T11:21:04.082 INFO:tasks.workunit.client.0.trial148.stdout: "count": 17 2026-02-17T11:21:04.083 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.083 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [], 2026-02-17T11:21:04.083 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:21:04.083 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.083 INFO:tasks.workunit.client.0.trial148.stdout: "OSD_DOWN": { 2026-02-17T11:21:04.083 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:21:04.083 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:21:04.083 INFO:tasks.workunit.client.0.trial148.stdout: "message": "1 osds down", 2026-02-17T11:21:04.083 INFO:tasks.workunit.client.0.trial148.stdout: "count": 1 2026-02-17T11:21:04.083 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.083 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:21:04.084 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.084 INFO:tasks.workunit.client.0.trial148.stdout: "message": "osd.1 (root=default,host=trial148) is down" 2026-02-17T11:21:04.084 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.084 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:21:04.084 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:21:04.084 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.084 INFO:tasks.workunit.client.0.trial148.stdout: "PG_DEGRADED": { 2026-02-17T11:21:04.084 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:21:04.084 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:21:04.084 INFO:tasks.workunit.client.0.trial148.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-17T11:21:04.084 INFO:tasks.workunit.client.0.trial148.stdout: "count": 32 2026-02-17T11:21:04.084 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.085 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:21:04.085 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.085 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.085 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.085 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.085 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.085 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.085 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.085 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.085 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.085 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.085 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.086 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.086 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.086 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.086 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.086 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.086 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.086 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.086 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.086 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.086 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.086 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.086 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.086 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.087 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.087 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.087 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.087 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.087 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.087 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.087 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.087 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.087 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.087 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.087 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.087 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.088 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.088 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.088 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.088 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.088 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.088 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.088 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.088 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.088 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.088 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.088 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.088 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.088 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.089 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.089 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.089 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.089 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.089 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.089 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.089 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.089 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.089 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.089 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.089 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.089 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.089 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.090 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.090 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.090 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.090 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.090 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.090 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.090 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.090 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.090 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.090 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.090 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.090 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.090 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.091 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.091 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.091 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.091 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.091 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.091 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.091 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.091 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.091 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.091 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.091 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.091 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.092 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.092 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.092 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.092 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.092 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.092 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.092 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.092 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-17T11:21:04.092 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.092 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:21:04.092 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:21:04.092 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.092 INFO:tasks.workunit.client.0.trial148.stdout: "POOL_APP_NOT_ENABLED": { 2026-02-17T11:21:04.093 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:21:04.093 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:21:04.093 INFO:tasks.workunit.client.0.trial148.stdout: "message": "1 pool(s) do not have an application enabled", 2026-02-17T11:21:04.093 INFO:tasks.workunit.client.0.trial148.stdout: "count": 1 2026-02-17T11:21:04.093 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.093 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:21:04.093 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.093 INFO:tasks.workunit.client.0.trial148.stdout: "message": "application not enabled on pool 'test'" 2026-02-17T11:21:04.093 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.093 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.094 INFO:tasks.workunit.client.0.trial148.stdout: "message": "use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." 2026-02-17T11:21:04.094 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.094 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:21:04.094 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:21:04.094 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.094 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.094 INFO:tasks.workunit.client.0.trial148.stdout: "mutes": [] 2026-02-17T11:21:04.094 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.094 INFO:tasks.workunit.client.0.trial148.stdout: "monmap_first_committed": 1, 2026-02-17T11:21:04.094 INFO:tasks.workunit.client.0.trial148.stdout: "monmap_last_committed": 1, 2026-02-17T11:21:04.094 INFO:tasks.workunit.client.0.trial148.stdout: "monmap": { 2026-02-17T11:21:04.095 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 1, 2026-02-17T11:21:04.095 INFO:tasks.workunit.client.0.trial148.stdout: "fsid": "0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a", 2026-02-17T11:21:04.095 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:18:59.385810Z", 2026-02-17T11:21:04.095 INFO:tasks.workunit.client.0.trial148.stdout: "created": "2026-02-17T11:18:59.385810Z", 2026-02-17T11:21:04.095 INFO:tasks.workunit.client.0.trial148.stdout: "min_mon_release": 19, 2026-02-17T11:21:04.095 INFO:tasks.workunit.client.0.trial148.stdout: "min_mon_release_name": "squid", 2026-02-17T11:21:04.095 INFO:tasks.workunit.client.0.trial148.stdout: "election_strategy": 1, 2026-02-17T11:21:04.095 INFO:tasks.workunit.client.0.trial148.stdout: "disallowed_leaders": "", 2026-02-17T11:21:04.095 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode": false, 2026-02-17T11:21:04.095 INFO:tasks.workunit.client.0.trial148.stdout: "tiebreaker_mon": "", 2026-02-17T11:21:04.095 INFO:tasks.workunit.client.0.trial148.stdout: "removed_ranks": "", 2026-02-17T11:21:04.095 INFO:tasks.workunit.client.0.trial148.stdout: "features": { 2026-02-17T11:21:04.095 INFO:tasks.workunit.client.0.trial148.stdout: "persistent": [ 2026-02-17T11:21:04.096 INFO:tasks.workunit.client.0.trial148.stdout: "kraken", 2026-02-17T11:21:04.096 INFO:tasks.workunit.client.0.trial148.stdout: "luminous", 2026-02-17T11:21:04.096 INFO:tasks.workunit.client.0.trial148.stdout: "mimic", 2026-02-17T11:21:04.096 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap-prune", 2026-02-17T11:21:04.096 INFO:tasks.workunit.client.0.trial148.stdout: "nautilus", 2026-02-17T11:21:04.096 INFO:tasks.workunit.client.0.trial148.stdout: "octopus", 2026-02-17T11:21:04.096 INFO:tasks.workunit.client.0.trial148.stdout: "pacific", 2026-02-17T11:21:04.096 INFO:tasks.workunit.client.0.trial148.stdout: "elector-pinging", 2026-02-17T11:21:04.096 INFO:tasks.workunit.client.0.trial148.stdout: "quincy", 2026-02-17T11:21:04.096 INFO:tasks.workunit.client.0.trial148.stdout: "reef", 2026-02-17T11:21:04.096 INFO:tasks.workunit.client.0.trial148.stdout: "squid" 2026-02-17T11:21:04.096 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:21:04.096 INFO:tasks.workunit.client.0.trial148.stdout: "optional": [] 2026-02-17T11:21:04.097 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.097 INFO:tasks.workunit.client.0.trial148.stdout: "mons": [ 2026-02-17T11:21:04.097 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.097 INFO:tasks.workunit.client.0.trial148.stdout: "rank": 0, 2026-02-17T11:21:04.097 INFO:tasks.workunit.client.0.trial148.stdout: "name": "a", 2026-02-17T11:21:04.097 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:21:04.097 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:21:04.097 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.097 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:21:04.097 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:7115", 2026-02-17T11:21:04.097 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 0 2026-02-17T11:21:04.097 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.097 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.098 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.098 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T11:21:04.098 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T11:21:04.098 INFO:tasks.workunit.client.0.trial148.stdout: "priority": 0, 2026-02-17T11:21:04.098 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 0, 2026-02-17T11:21:04.098 INFO:tasks.workunit.client.0.trial148.stdout: "crush_location": "{}" 2026-02-17T11:21:04.098 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.098 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.098 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.098 INFO:tasks.workunit.client.0.trial148.stdout: "quorum": [ 2026-02-17T11:21:04.098 INFO:tasks.workunit.client.0.trial148.stdout: 0 2026-02-17T11:21:04.098 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:21:04.098 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap": { 2026-02-17T11:21:04.099 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 45, 2026-02-17T11:21:04.099 INFO:tasks.workunit.client.0.trial148.stdout: "fsid": "0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a", 2026-02-17T11:21:04.099 INFO:tasks.workunit.client.0.trial148.stdout: "created": "2026-02-17T11:18:59.471725+0000", 2026-02-17T11:21:04.099 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:20:04.732519+0000", 2026-02-17T11:21:04.099 INFO:tasks.workunit.client.0.trial148.stdout: "last_up_change": "2026-02-17T11:20:03.467160+0000", 2026-02-17T11:21:04.099 INFO:tasks.workunit.client.0.trial148.stdout: "last_in_change": "2026-02-17T11:20:04.629599+0000", 2026-02-17T11:21:04.099 INFO:tasks.workunit.client.0.trial148.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T11:21:04.099 INFO:tasks.workunit.client.0.trial148.stdout: "flags_num": 5800384, 2026-02-17T11:21:04.099 INFO:tasks.workunit.client.0.trial148.stdout: "flags_set": [ 2026-02-17T11:21:04.099 INFO:tasks.workunit.client.0.trial148.stdout: "nodown", 2026-02-17T11:21:04.099 INFO:tasks.workunit.client.0.trial148.stdout: "noin", 2026-02-17T11:21:04.099 INFO:tasks.workunit.client.0.trial148.stdout: "noout", 2026-02-17T11:21:04.100 INFO:tasks.workunit.client.0.trial148.stdout: "pglog_hardlimit", 2026-02-17T11:21:04.100 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snapdirs", 2026-02-17T11:21:04.100 INFO:tasks.workunit.client.0.trial148.stdout: "recovery_deletes", 2026-02-17T11:21:04.100 INFO:tasks.workunit.client.0.trial148.stdout: "sortbitwise" 2026-02-17T11:21:04.100 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:21:04.100 INFO:tasks.workunit.client.0.trial148.stdout: "crush_version": 9, 2026-02-17T11:21:04.100 INFO:tasks.workunit.client.0.trial148.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T11:21:04.100 INFO:tasks.workunit.client.0.trial148.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T11:21:04.100 INFO:tasks.workunit.client.0.trial148.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T11:21:04.100 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_snapshot": "", 2026-02-17T11:21:04.100 INFO:tasks.workunit.client.0.trial148.stdout: "pool_max": 1, 2026-02-17T11:21:04.100 INFO:tasks.workunit.client.0.trial148.stdout: "max_osd": 3, 2026-02-17T11:21:04.101 INFO:tasks.workunit.client.0.trial148.stdout: "require_min_compat_client": "luminous", 2026-02-17T11:21:04.101 INFO:tasks.workunit.client.0.trial148.stdout: "min_compat_client": "jewel", 2026-02-17T11:21:04.101 INFO:tasks.workunit.client.0.trial148.stdout: "require_osd_release": "squid", 2026-02-17T11:21:04.101 INFO:tasks.workunit.client.0.trial148.stdout: "allow_crimson": false, 2026-02-17T11:21:04.101 INFO:tasks.workunit.client.0.trial148.stdout: "pools": [ 2026-02-17T11:21:04.101 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.101 INFO:tasks.workunit.client.0.trial148.stdout: "pool": 1, 2026-02-17T11:21:04.101 INFO:tasks.workunit.client.0.trial148.stdout: "pool_name": "test", 2026-02-17T11:21:04.101 INFO:tasks.workunit.client.0.trial148.stdout: "create_time": "2026-02-17T11:19:27.640936+0000", 2026-02-17T11:21:04.101 INFO:tasks.workunit.client.0.trial148.stdout: "flags": 1, 2026-02-17T11:21:04.101 INFO:tasks.workunit.client.0.trial148.stdout: "flags_names": "hashpspool", 2026-02-17T11:21:04.101 INFO:tasks.workunit.client.0.trial148.stdout: "type": 1, 2026-02-17T11:21:04.101 INFO:tasks.workunit.client.0.trial148.stdout: "size": 3, 2026-02-17T11:21:04.101 INFO:tasks.workunit.client.0.trial148.stdout: "min_size": 2, 2026-02-17T11:21:04.102 INFO:tasks.workunit.client.0.trial148.stdout: "crush_rule": 0, 2026-02-17T11:21:04.102 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_count": 0, 2026-02-17T11:21:04.102 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_target": 0, 2026-02-17T11:21:04.102 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T11:21:04.102 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T11:21:04.102 INFO:tasks.workunit.client.0.trial148.stdout: "is_stretch_pool": false, 2026-02-17T11:21:04.102 INFO:tasks.workunit.client.0.trial148.stdout: "object_hash": 2, 2026-02-17T11:21:04.102 INFO:tasks.workunit.client.0.trial148.stdout: "pg_autoscale_mode": "on", 2026-02-17T11:21:04.102 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num": 32, 2026-02-17T11:21:04.102 INFO:tasks.workunit.client.0.trial148.stdout: "pg_placement_num": 1, 2026-02-17T11:21:04.102 INFO:tasks.workunit.client.0.trial148.stdout: "pg_placement_num_target": 32, 2026-02-17T11:21:04.102 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num_target": 32, 2026-02-17T11:21:04.102 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num_pending": 32, 2026-02-17T11:21:04.103 INFO:tasks.workunit.client.0.trial148.stdout: "last_pg_merge_meta": { 2026-02-17T11:21:04.103 INFO:tasks.workunit.client.0.trial148.stdout: "source_pgid": "0.0", 2026-02-17T11:21:04.103 INFO:tasks.workunit.client.0.trial148.stdout: "ready_epoch": 0, 2026-02-17T11:21:04.103 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_started": 0, 2026-02-17T11:21:04.103 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_clean": 0, 2026-02-17T11:21:04.103 INFO:tasks.workunit.client.0.trial148.stdout: "source_version": "0'0", 2026-02-17T11:21:04.103 INFO:tasks.workunit.client.0.trial148.stdout: "target_version": "0'0" 2026-02-17T11:21:04.103 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.103 INFO:tasks.workunit.client.0.trial148.stdout: "last_change": "40", 2026-02-17T11:21:04.103 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend": "0", 2026-02-17T11:21:04.103 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T11:21:04.104 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend_preluminous": "40", 2026-02-17T11:21:04.104 INFO:tasks.workunit.client.0.trial148.stdout: "auid": 0, 2026-02-17T11:21:04.104 INFO:tasks.workunit.client.0.trial148.stdout: "snap_mode": "selfmanaged", 2026-02-17T11:21:04.104 INFO:tasks.workunit.client.0.trial148.stdout: "snap_seq": 0, 2026-02-17T11:21:04.104 INFO:tasks.workunit.client.0.trial148.stdout: "snap_epoch": 0, 2026-02-17T11:21:04.104 INFO:tasks.workunit.client.0.trial148.stdout: "pool_snaps": [], 2026-02-17T11:21:04.104 INFO:tasks.workunit.client.0.trial148.stdout: "removed_snaps": "[]", 2026-02-17T11:21:04.104 INFO:tasks.workunit.client.0.trial148.stdout: "quota_max_bytes": 0, 2026-02-17T11:21:04.104 INFO:tasks.workunit.client.0.trial148.stdout: "quota_max_objects": 0, 2026-02-17T11:21:04.104 INFO:tasks.workunit.client.0.trial148.stdout: "tiers": [], 2026-02-17T11:21:04.104 INFO:tasks.workunit.client.0.trial148.stdout: "tier_of": -1, 2026-02-17T11:21:04.104 INFO:tasks.workunit.client.0.trial148.stdout: "read_tier": -1, 2026-02-17T11:21:04.105 INFO:tasks.workunit.client.0.trial148.stdout: "write_tier": -1, 2026-02-17T11:21:04.105 INFO:tasks.workunit.client.0.trial148.stdout: "cache_mode": "none", 2026-02-17T11:21:04.105 INFO:tasks.workunit.client.0.trial148.stdout: "target_max_bytes": 0, 2026-02-17T11:21:04.105 INFO:tasks.workunit.client.0.trial148.stdout: "target_max_objects": 0, 2026-02-17T11:21:04.105 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T11:21:04.105 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T11:21:04.105 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T11:21:04.105 INFO:tasks.workunit.client.0.trial148.stdout: "cache_min_flush_age": 0, 2026-02-17T11:21:04.105 INFO:tasks.workunit.client.0.trial148.stdout: "cache_min_evict_age": 0, 2026-02-17T11:21:04.105 INFO:tasks.workunit.client.0.trial148.stdout: "erasure_code_profile": "", 2026-02-17T11:21:04.105 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_params": { 2026-02-17T11:21:04.105 INFO:tasks.workunit.client.0.trial148.stdout: "type": "none" 2026-02-17T11:21:04.105 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.106 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_period": 0, 2026-02-17T11:21:04.106 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_count": 0, 2026-02-17T11:21:04.106 INFO:tasks.workunit.client.0.trial148.stdout: "use_gmt_hitset": true, 2026-02-17T11:21:04.106 INFO:tasks.workunit.client.0.trial148.stdout: "min_read_recency_for_promote": 0, 2026-02-17T11:21:04.106 INFO:tasks.workunit.client.0.trial148.stdout: "min_write_recency_for_promote": 0, 2026-02-17T11:21:04.106 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T11:21:04.106 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_search_last_n": 0, 2026-02-17T11:21:04.106 INFO:tasks.workunit.client.0.trial148.stdout: "grade_table": [], 2026-02-17T11:21:04.106 INFO:tasks.workunit.client.0.trial148.stdout: "stripe_width": 0, 2026-02-17T11:21:04.106 INFO:tasks.workunit.client.0.trial148.stdout: "expected_num_objects": 0, 2026-02-17T11:21:04.106 INFO:tasks.workunit.client.0.trial148.stdout: "fast_read": false, 2026-02-17T11:21:04.106 INFO:tasks.workunit.client.0.trial148.stdout: "options": {}, 2026-02-17T11:21:04.106 INFO:tasks.workunit.client.0.trial148.stdout: "application_metadata": {}, 2026-02-17T11:21:04.107 INFO:tasks.workunit.client.0.trial148.stdout: "read_balance": { 2026-02-17T11:21:04.107 INFO:tasks.workunit.client.0.trial148.stdout: "score_type": "Fair distribution", 2026-02-17T11:21:04.107 INFO:tasks.workunit.client.0.trial148.stdout: "score_acting": 2.9900000095367432, 2026-02-17T11:21:04.107 INFO:tasks.workunit.client.0.trial148.stdout: "score_stable": 2.9900000095367432, 2026-02-17T11:21:04.107 INFO:tasks.workunit.client.0.trial148.stdout: "optimal_score": 0.67000001668930054, 2026-02-17T11:21:04.107 INFO:tasks.workunit.client.0.trial148.stdout: "raw_score_acting": 2, 2026-02-17T11:21:04.107 INFO:tasks.workunit.client.0.trial148.stdout: "raw_score_stable": 2, 2026-02-17T11:21:04.107 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity_weighted": 1, 2026-02-17T11:21:04.107 INFO:tasks.workunit.client.0.trial148.stdout: "average_primary_affinity": 1, 2026-02-17T11:21:04.107 INFO:tasks.workunit.client.0.trial148.stdout: "average_primary_affinity_weighted": 1 2026-02-17T11:21:04.107 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.107 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.107 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:21:04.107 INFO:tasks.workunit.client.0.trial148.stdout: "osds": [ 2026-02-17T11:21:04.108 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.108 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:21:04.108 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "445c6994-5669-4311-9e55-f2c103270e94", 2026-02-17T11:21:04.108 INFO:tasks.workunit.client.0.trial148.stdout: "up": 1, 2026-02-17T11:21:04.108 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:21:04.108 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:21:04.108 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:21:04.108 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 5, 2026-02-17T11:21:04.108 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 29, 2026-02-17T11:21:04.108 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 36, 2026-02-17T11:21:04.108 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 44, 2026-02-17T11:21:04.108 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 30, 2026-02-17T11:21:04.108 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:21:04.109 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:21:04.109 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:21:04.109 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.109 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:21:04.109 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6802", 2026-02-17T11:21:04.109 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3809649686 2026-02-17T11:21:04.109 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.109 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.109 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:21:04.109 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6803", 2026-02-17T11:21:04.109 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3809649686 2026-02-17T11:21:04.109 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.109 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.110 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.110 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:21:04.110 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:21:04.110 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.110 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:21:04.110 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6804", 2026-02-17T11:21:04.110 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3809649686 2026-02-17T11:21:04.110 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.110 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.110 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:21:04.110 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6805", 2026-02-17T11:21:04.110 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3809649686 2026-02-17T11:21:04.111 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.111 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.111 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.111 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:21:04.111 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:21:04.111 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.111 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:21:04.111 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6808", 2026-02-17T11:21:04.111 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3809649686 2026-02-17T11:21:04.111 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.111 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.111 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:21:04.111 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6809", 2026-02-17T11:21:04.112 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3809649686 2026-02-17T11:21:04.112 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.112 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.112 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.112 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:21:04.112 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:21:04.112 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.112 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:21:04.112 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6806", 2026-02-17T11:21:04.112 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3809649686 2026-02-17T11:21:04.112 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.112 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.112 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:21:04.113 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6807", 2026-02-17T11:21:04.113 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3809649686 2026-02-17T11:21:04.113 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.113 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.113 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.113 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6803/3809649686", 2026-02-17T11:21:04.113 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6805/3809649686", 2026-02-17T11:21:04.113 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6809/3809649686", 2026-02-17T11:21:04.113 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6807/3809649686", 2026-02-17T11:21:04.113 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:21:04.113 INFO:tasks.workunit.client.0.trial148.stdout: "exists", 2026-02-17T11:21:04.114 INFO:tasks.workunit.client.0.trial148.stdout: "up" 2026-02-17T11:21:04.114 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.114 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.114 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.114 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:21:04.114 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "2c40e141-b07b-4dad-aaf4-9c213ae159a3", 2026-02-17T11:21:04.114 INFO:tasks.workunit.client.0.trial148.stdout: "up": 0, 2026-02-17T11:21:04.114 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:21:04.114 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:21:04.114 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:21:04.114 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 0, 2026-02-17T11:21:04.114 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 0, 2026-02-17T11:21:04.115 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 10, 2026-02-17T11:21:04.115 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 21, 2026-02-17T11:21:04.115 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 31, 2026-02-17T11:21:04.115 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:21:04.115 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:21:04.115 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:21:04.115 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.115 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:21:04.115 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6810", 2026-02-17T11:21:04.116 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2601695318 2026-02-17T11:21:04.116 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.116 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.116 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:21:04.116 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6811", 2026-02-17T11:21:04.116 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2601695318 2026-02-17T11:21:04.116 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.116 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.116 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.116 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:21:04.116 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:21:04.116 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.116 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:21:04.116 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6812", 2026-02-17T11:21:04.117 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2601695318 2026-02-17T11:21:04.117 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.117 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.117 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:21:04.117 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6813", 2026-02-17T11:21:04.117 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2601695318 2026-02-17T11:21:04.117 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.117 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.117 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.117 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:21:04.117 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:21:04.117 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.117 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:21:04.117 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6816", 2026-02-17T11:21:04.118 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2601695318 2026-02-17T11:21:04.118 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.118 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.118 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:21:04.118 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6817", 2026-02-17T11:21:04.118 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2601695318 2026-02-17T11:21:04.118 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.118 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.118 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.118 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:21:04.118 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:21:04.118 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.118 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:21:04.118 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6814", 2026-02-17T11:21:04.119 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2601695318 2026-02-17T11:21:04.119 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.119 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.119 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:21:04.119 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6815", 2026-02-17T11:21:04.119 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 2601695318 2026-02-17T11:21:04.119 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.119 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.119 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.119 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6811/2601695318", 2026-02-17T11:21:04.119 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6813/2601695318", 2026-02-17T11:21:04.119 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6817/2601695318", 2026-02-17T11:21:04.119 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6815/2601695318", 2026-02-17T11:21:04.120 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:21:04.120 INFO:tasks.workunit.client.0.trial148.stdout: "exists" 2026-02-17T11:21:04.120 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.120 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.120 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.120 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:21:04.120 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "2dfcc774-bf64-4f70-a754-84bb2859cd23", 2026-02-17T11:21:04.120 INFO:tasks.workunit.client.0.trial148.stdout: "up": 1, 2026-02-17T11:21:04.120 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:21:04.120 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:21:04.120 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:21:04.120 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 14, 2026-02-17T11:21:04.120 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 29, 2026-02-17T11:21:04.120 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 39, 2026-02-17T11:21:04.120 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 0, 2026-02-17T11:21:04.120 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 32, 2026-02-17T11:21:04.121 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:21:04.121 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:21:04.121 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:21:04.121 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.121 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:21:04.121 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6810", 2026-02-17T11:21:04.121 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3194056430 2026-02-17T11:21:04.121 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.121 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.121 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:21:04.121 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6811", 2026-02-17T11:21:04.121 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3194056430 2026-02-17T11:21:04.121 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.121 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.121 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.121 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:21:04.122 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:21:04.122 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.122 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:21:04.122 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6812", 2026-02-17T11:21:04.122 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3194056430 2026-02-17T11:21:04.122 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.122 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.122 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:21:04.122 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6813", 2026-02-17T11:21:04.122 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3194056430 2026-02-17T11:21:04.122 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.122 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.122 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.122 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:21:04.122 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:21:04.122 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.123 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:21:04.123 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6816", 2026-02-17T11:21:04.123 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3194056430 2026-02-17T11:21:04.123 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.123 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.123 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:21:04.123 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6817", 2026-02-17T11:21:04.123 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3194056430 2026-02-17T11:21:04.123 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.123 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.123 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.123 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:21:04.123 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:21:04.123 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.123 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:21:04.123 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6814", 2026-02-17T11:21:04.123 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3194056430 2026-02-17T11:21:04.124 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.124 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.124 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:21:04.124 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6815", 2026-02-17T11:21:04.124 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3194056430 2026-02-17T11:21:04.124 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.124 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.124 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.124 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6811/3194056430", 2026-02-17T11:21:04.124 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6813/3194056430", 2026-02-17T11:21:04.124 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3194056430", 2026-02-17T11:21:04.124 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3194056430", 2026-02-17T11:21:04.124 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:21:04.124 INFO:tasks.workunit.client.0.trial148.stdout: "exists", 2026-02-17T11:21:04.125 INFO:tasks.workunit.client.0.trial148.stdout: "up" 2026-02-17T11:21:04.125 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.125 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.125 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:21:04.125 INFO:tasks.workunit.client.0.trial148.stdout: "osd_xinfo": [ 2026-02-17T11:21:04.125 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.125 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:21:04.125 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:19:52.377976+0000", 2026-02-17T11:21:04.125 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:21:04.125 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:21:04.125 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:21:04.125 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:21:04.125 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "2026-02-17T11:19:08.517276+0000", 2026-02-17T11:21:04.125 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:21:04.125 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.125 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.125 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:21:04.126 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:19:52.649190+0000", 2026-02-17T11:21:04.126 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:21:04.126 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:21:04.126 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:21:04.126 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:21:04.126 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-17T11:21:04.126 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:21:04.126 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.126 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.126 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:21:04.126 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:19:52.919019+0000", 2026-02-17T11:21:04.126 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:21:04.126 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:21:04.126 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:21:04.126 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:21:04.126 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "2026-02-17T11:19:25.912537+0000", 2026-02-17T11:21:04.126 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:21:04.126 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.127 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:21:04.127 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap": [], 2026-02-17T11:21:04.127 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap_items": [], 2026-02-17T11:21:04.127 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap_primaries": [], 2026-02-17T11:21:04.127 INFO:tasks.workunit.client.0.trial148.stdout: "pg_temp": [], 2026-02-17T11:21:04.127 INFO:tasks.workunit.client.0.trial148.stdout: "primary_temp": [], 2026-02-17T11:21:04.127 INFO:tasks.workunit.client.0.trial148.stdout: "blocklist": {}, 2026-02-17T11:21:04.127 INFO:tasks.workunit.client.0.trial148.stdout: "range_blocklist": {}, 2026-02-17T11:21:04.127 INFO:tasks.workunit.client.0.trial148.stdout: "erasure_code_profiles": { 2026-02-17T11:21:04.127 INFO:tasks.workunit.client.0.trial148.stdout: "default": { 2026-02-17T11:21:04.127 INFO:tasks.workunit.client.0.trial148.stdout: "k": "2", 2026-02-17T11:21:04.127 INFO:tasks.workunit.client.0.trial148.stdout: "m": "2", 2026-02-17T11:21:04.127 INFO:tasks.workunit.client.0.trial148.stdout: "plugin": "jerasure", 2026-02-17T11:21:04.127 INFO:tasks.workunit.client.0.trial148.stdout: "technique": "reed_sol_van" 2026-02-17T11:21:04.127 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.127 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.127 INFO:tasks.workunit.client.0.trial148.stdout: "removed_snaps_queue": [], 2026-02-17T11:21:04.127 INFO:tasks.workunit.client.0.trial148.stdout: "new_removed_snaps": [], 2026-02-17T11:21:04.128 INFO:tasks.workunit.client.0.trial148.stdout: "new_purged_snaps": [], 2026-02-17T11:21:04.128 INFO:tasks.workunit.client.0.trial148.stdout: "crush_node_flags": {}, 2026-02-17T11:21:04.128 INFO:tasks.workunit.client.0.trial148.stdout: "device_class_flags": {}, 2026-02-17T11:21:04.128 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode": { 2026-02-17T11:21:04.128 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode_enabled": false, 2026-02-17T11:21:04.128 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_bucket_count": 0, 2026-02-17T11:21:04.128 INFO:tasks.workunit.client.0.trial148.stdout: "degraded_stretch_mode": 0, 2026-02-17T11:21:04.128 INFO:tasks.workunit.client.0.trial148.stdout: "recovering_stretch_mode": 0, 2026-02-17T11:21:04.128 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode_bucket": 0 2026-02-17T11:21:04.128 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.128 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.128 INFO:tasks.workunit.client.0.trial148.stdout: "osd_metadata": [ 2026-02-17T11:21:04.128 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.128 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:21:04.128 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:21:04.128 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6804/3809649686,v1:127.0.0.1:6805/3809649686]", 2026-02-17T11:21:04.128 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:21:04.128 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:21:04.129 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:21:04.129 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:21:04.129 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:21:04.129 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:21:04.129 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:21:04.129 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:21:04.129 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:21:04.129 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:21:04.129 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:21:04.129 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:21:04.129 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T11:21:04.129 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:21:04.129 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:21:04.129 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:21:04.129 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:21:04.129 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:21:04.129 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:21:04.129 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:21:04.129 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:21:04.130 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:21:04.130 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:21:04.130 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:19:02.118788Z", 2026-02-17T11:21:04.130 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:21:04.130 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:21:04.130 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:21:04.130 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:21:04.130 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:21:04.130 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:21:04.130 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:21:04.130 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6802/3809649686,v1:127.0.0.1:6803/3809649686]", 2026-02-17T11:21:04.130 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:21:04.130 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/3809649686,v1:127.0.0.1:6809/3809649686]", 2026-02-17T11:21:04.130 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/3809649686,v1:127.0.0.1:6807/3809649686]", 2026-02-17T11:21:04.130 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:21:04.130 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:21:04.130 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:21:04.130 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:21:04.131 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:21:04.131 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:21:04.131 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:21:04.131 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:21:04.131 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:21:04.131 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:21:04.131 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T11:21:04.131 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:21:04.131 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:21:04.131 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:21:04.131 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.131 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.131 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:21:04.131 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:21:04.131 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6812/2601695318,v1:127.0.0.1:6813/2601695318]", 2026-02-17T11:21:04.131 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:21:04.132 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:21:04.132 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:21:04.132 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:21:04.132 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:21:04.132 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:21:04.132 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:21:04.132 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:21:04.132 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:21:04.132 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:21:04.132 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:21:04.132 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:21:04.132 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T11:21:04.132 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:21:04.132 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:21:04.132 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:21:04.132 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:21:04.132 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:21:04.132 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:21:04.132 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:21:04.133 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:21:04.133 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:21:04.133 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:21:04.133 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:19:10.125329Z", 2026-02-17T11:21:04.133 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:21:04.133 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:21:04.133 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:21:04.133 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:21:04.133 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:21:04.133 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:21:04.133 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:21:04.133 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6810/2601695318,v1:127.0.0.1:6811/2601695318]", 2026-02-17T11:21:04.133 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:21:04.133 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/2601695318,v1:127.0.0.1:6817/2601695318]", 2026-02-17T11:21:04.133 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/2601695318,v1:127.0.0.1:6815/2601695318]", 2026-02-17T11:21:04.133 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:21:04.133 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:21:04.133 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:21:04.134 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:21:04.134 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:21:04.134 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:21:04.134 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:21:04.134 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:21:04.134 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:21:04.134 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:21:04.134 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T11:21:04.134 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:21:04.134 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:21:04.134 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:21:04.134 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.134 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.134 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:21:04.134 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:21:04.134 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6812/3194056430,v1:127.0.0.1:6813/3194056430]", 2026-02-17T11:21:04.134 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:21:04.135 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:19:19.338643Z", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6810/3194056430,v1:127.0.0.1:6811/3194056430]", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3194056430,v1:127.0.0.1:6817/3194056430]", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3194056430,v1:127.0.0.1:6815/3194056430]", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:21:04.136 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_clean_epochs": { 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: "min_last_epoch_clean": 0, 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_clean": { 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: "per_pool": [] 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: "osd_epochs": [ 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 36 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.137 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 40 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_first_committed": 1, 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_last_committed": 45, 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: "crushmap": { 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: "devices": [ 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.0", 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.1", 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:21:04.138 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.2", 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: "types": [ 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 0, 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd" 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: "name": "host" 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 2, 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: "name": "chassis" 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 3, 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: "name": "rack" 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.139 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 4, 2026-02-17T11:21:04.140 INFO:tasks.workunit.client.0.trial148.stdout: "name": "row" 2026-02-17T11:21:04.140 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.140 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.140 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 5, 2026-02-17T11:21:04.140 INFO:tasks.workunit.client.0.trial148.stdout: "name": "pdu" 2026-02-17T11:21:04.140 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.140 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.140 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 6, 2026-02-17T11:21:04.140 INFO:tasks.workunit.client.0.trial148.stdout: "name": "pod" 2026-02-17T11:21:04.140 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.140 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.140 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 7, 2026-02-17T11:21:04.140 INFO:tasks.workunit.client.0.trial148.stdout: "name": "room" 2026-02-17T11:21:04.140 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.140 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.140 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 8, 2026-02-17T11:21:04.140 INFO:tasks.workunit.client.0.trial148.stdout: "name": "datacenter" 2026-02-17T11:21:04.140 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.140 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.141 INFO:tasks.workunit.client.0.trial148.stderr:report 3200469018 2026-02-17T11:21:04.141 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 9, 2026-02-17T11:21:04.141 INFO:tasks.workunit.client.0.trial148.stdout: "name": "zone" 2026-02-17T11:21:04.141 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.141 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.141 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 10, 2026-02-17T11:21:04.141 INFO:tasks.workunit.client.0.trial148.stdout: "name": "region" 2026-02-17T11:21:04.141 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.141 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.141 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:21:04.141 INFO:tasks.workunit.client.0.trial148.stdout: "name": "root" 2026-02-17T11:21:04.141 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.141 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:21:04.141 INFO:tasks.workunit.client.0.trial148.stdout: "buckets": [ 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: "id": -1, 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: "name": "default", 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "root", 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: "id": -3, 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: "id": -2, 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: "name": "default~ssd", 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "root", 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:21:04.142 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: "id": -4, 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: "id": -3, 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: "name": "trial148", 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "host", 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.143 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 1 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 2 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: "id": -4, 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: "name": "trial148~ssd", 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "host", 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:21:04.144 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 1 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 2 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: "rules": [ 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: "rule_id": 0, 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: "rule_name": "replicated_rule", 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: "type": 1, 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: "steps": [ 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: "op": "take", 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: "item": -1, 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: "item_name": "default" 2026-02-17T11:21:04.145 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: "op": "choose_firstn", 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: "num": 0, 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: "type": "osd" 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: "op": "emit" 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: "tunables": { 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: "choose_local_tries": 0, 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: "choose_local_fallback_tries": 0, 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: "choose_total_tries": 50, 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_descend_once": 1, 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_vary_r": 1, 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_stable": 1, 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: "msr_descents": 100, 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: "msr_collision_tries": 100, 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: "straw_calc_version": 1, 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: "allowed_bucket_algs": 54, 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: "profile": "jewel", 2026-02-17T11:21:04.146 INFO:tasks.workunit.client.0.trial148.stdout: "optimal_tunables": 1, 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "legacy_tunables": 0, 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "minimum_required_version": "jewel", 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables": 1, 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables2": 1, 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "has_v2_rules": 0, 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables3": 1, 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "has_v3_rules": 0, 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "has_v4_buckets": 1, 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables5": 1, 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "has_v5_rules": 0, 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "has_msr_rules": 0 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "choose_args": {} 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "fsmap": { 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 1, 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "btime": "2026-02-17T11:18:59:471505+0000", 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "default_fscid": -1, 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "compat": { 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "compat": {}, 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "ro_compat": {}, 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "incompat": { 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "feature_1": "base v0.20", 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "feature_2": "client writeable ranges", 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "feature_4": "dir inode in separate object", 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T11:21:04.147 INFO:tasks.workunit.client.0.trial148.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "feature_8": "no anchor table", 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "feature_9": "file layout v2", 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "feature_10": "snaprealm v2", 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "feature_11": "minor log segments", 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "feature_flags": { 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "enable_multiple": true, 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "ever_enabled_multiple": true 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "standbys": [], 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "filesystems": [] 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "mdsmap_first_committed": 1, 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "mdsmap_last_committed": 1, 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "auth": { 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "first_committed": 1, 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "last_committed": 5, 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "num_secrets": 3 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg": 32, 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_active": 32, 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_unknown": 0, 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "num_osd": 3, 2026-02-17T11:21:04.148 INFO:tasks.workunit.client.0.trial148.stdout: "pool_sum": { 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "stat_sum": { 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes": 69772, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects": 100, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_clones": 0, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_copies": 300, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing": 0, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_degraded": 100, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_misplaced": 0, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_unfound": 0, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_dirty": 100, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_whiteouts": 0, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_read": 0, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_read_kb": 0, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_write": 101, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_write_kb": 101, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_scrub_errors": 0, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_deep_scrub_errors": 0, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_recovered": 0, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_recovered": 0, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_keys_recovered": 0, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_omap": 0, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush": 0, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_kb": 0, 2026-02-17T11:21:04.149 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_kb": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "num_promote": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_high": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_low": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_some": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_full": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_pinned": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "num_legacy_snapsets": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "num_large_omap_objects": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_manifest": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_bytes": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_keys": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_repaired": 0 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "store_stats": { 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "total": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "available": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 0, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 0 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "log_size": 513, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "ondisk_log_size": 513, 2026-02-17T11:21:04.150 INFO:tasks.workunit.client.0.trial148.stdout: "up": 64, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "acting": 64, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "num_store_stats": 0 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "osd_sum": { 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 0, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 0, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "num_pgs": 65, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "num_osds": 3, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_osds": 3, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "kb": 314572800, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used": 84004, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_data": 2168, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_omap": 10, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_meta": 81717, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "kb_avail": 314488796, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "statfs": { 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "total": 322122547200, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "available": 322036527104, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 2220032, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 518389, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 10389, 2026-02-17T11:21:04.151 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 83679083 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "hb_peers": [], 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "snap_trim_queue_len": 0, 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "num_snap_trimming": 0, 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "num_shards_repaired": 0, 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "op_queue_age_hist": { 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "histogram": [], 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "upper_bound": 1 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "perf_stat": { 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ms": 0, 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ms": 0, 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ns": 0, 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ns": 0 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "alerts": [], 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "network_ping_times": [] 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "osd_sum_by_class": { 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "ssd": { 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 0, 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 0, 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "num_pgs": 65, 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "num_osds": 3, 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_osds": 3, 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "kb": 314572800, 2026-02-17T11:21:04.152 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used": 84004, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_data": 2168, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_omap": 10, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_meta": 81717, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "kb_avail": 314488796, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "statfs": { 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "total": 322122547200, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "available": 322036527104, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 2220032, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 518389, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 10389, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 83679083 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "hb_peers": [], 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "snap_trim_queue_len": 0, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "num_snap_trimming": 0, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "num_shards_repaired": 0, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "op_queue_age_hist": { 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "histogram": [], 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "upper_bound": 1 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "perf_stat": { 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ms": 0, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ms": 0, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ns": 0, 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ns": 0 2026-02-17T11:21:04.153 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "alerts": [], 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "network_ping_times": [] 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "pool_stats": [ 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "poolid": 1, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg": 32, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "stat_sum": { 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes": 69772, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects": 100, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_clones": 0, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_copies": 300, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing": 0, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_degraded": 100, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_misplaced": 0, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_unfound": 0, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_dirty": 100, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_whiteouts": 0, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_read": 0, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_read_kb": 0, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_write": 101, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_write_kb": 101, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_scrub_errors": 0, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_deep_scrub_errors": 0, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_recovered": 0, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_recovered": 0, 2026-02-17T11:21:04.154 INFO:tasks.workunit.client.0.trial148.stdout: "num_keys_recovered": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_omap": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_kb": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_kb": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "num_promote": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_high": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_low": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_some": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_full": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_pinned": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "num_legacy_snapsets": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "num_large_omap_objects": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_manifest": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_bytes": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_keys": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_repaired": 0 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "store_stats": { 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "total": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "available": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 1220608, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 208198, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 0, 2026-02-17T11:21:04.155 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 0 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: "log_size": 513, 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: "ondisk_log_size": 513, 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: "up": 64, 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: "acting": 64, 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: "num_store_stats": 3 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: "osd_stats": [ 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 154618822673 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 42949672974 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 167503724560 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_by_state": [ 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: "state": "active+undersized+degraded", 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: "num": 32 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_by_osd": [ 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:21:04.156 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 0, 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 32, 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 32, 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 32, 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 0, 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 0, 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snaps": [ 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "pool": 1, 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snaps": {} 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "servicemap": { 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 5, 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:20:59.858741+0000", 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "services": { 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "osd": { 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "daemons": { 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "summary": "", 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "2": { 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "start_epoch": 0, 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "start_stamp": "0.000000", 2026-02-17T11:21:04.157 INFO:tasks.workunit.client.0.trial148.stdout: "gid": 0, 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout: "metadata": {}, 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout: "task_status": {} 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout: "mgrstat_first_committed": 1, 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout: "mgrstat_last_committed": 60, 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout: "logm_first_committed": 1, 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout: "logm_last_committed": 289, 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout: "paxos": { 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout: "first_committed": 1, 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout: "last_committed": 404, 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout: "last_pn": 0, 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout: "accepted_pn": 0 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1680: wait_for_clean: return 1 2026-02-17T11:21:04.158 INFO:tasks.workunit.client.0.trial148.stdout:delay recovery 2026-02-17T11:21:04.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:761: TEST_divergent_3: echo 'delay recovery' 2026-02-17T11:21:04.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:762: TEST_divergent_3: ceph pg dump pgs 2026-02-17T11:21:04.282 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:21:04.282 INFO:tasks.workunit.client.0.trial148.stdout:1.1f 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535289+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444687+0000 0 0 2026-02-17T11:21:04.282 INFO:tasks.workunit.client.0.trial148.stdout:1.1e 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535158+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444634+0000 0 0 2026-02-17T11:21:04.282 INFO:tasks.workunit.client.0.trial148.stdout:1.1d 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534901+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444484+0000 0 0 2026-02-17T11:21:04.282 INFO:tasks.workunit.client.0.trial148.stdout:1.b 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533702+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444624+0000 0 0 2026-02-17T11:21:04.282 INFO:tasks.workunit.client.0.trial148.stdout:1.a 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533669+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444651+0000 0 0 2026-02-17T11:21:04.282 INFO:tasks.workunit.client.0.trial148.stdout:1.9 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533725+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444570+0000 0 0 2026-02-17T11:21:04.282 INFO:tasks.workunit.client.0.trial148.stdout:1.8 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533667+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444579+0000 0 0 2026-02-17T11:21:04.282 INFO:tasks.workunit.client.0.trial148.stdout:1.7 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535004+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444724+0000 0 0 2026-02-17T11:21:04.282 INFO:tasks.workunit.client.0.trial148.stdout:1.6 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534716+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444705+0000 0 0 2026-02-17T11:21:04.282 INFO:tasks.workunit.client.0.trial148.stdout:1.5 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533622+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444597+0000 0 0 2026-02-17T11:21:04.282 INFO:tasks.workunit.client.0.trial148.stdout:1.4 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533612+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444669+0000 0 0 2026-02-17T11:21:04.282 INFO:tasks.workunit.client.0.trial148.stdout:1.3 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533558+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444642+0000 0 0 2026-02-17T11:21:04.282 INFO:tasks.workunit.client.0.trial148.stdout:1.2 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533725+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444615+0000 0 0 2026-02-17T11:21:04.282 INFO:tasks.workunit.client.0.trial148.stdout:1.c 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534661+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444606+0000 0 0 2026-02-17T11:21:04.282 INFO:tasks.workunit.client.0.trial148.stdout:1.1 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533554+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444661+0000 0 0 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stdout:1.1c 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535631+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444514+0000 0 0 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stdout:1.0 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533565+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444440+0000 0 0 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stdout:1.d 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534577+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444588+0000 0 0 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stdout:1.e 3 0 3 0 0 2444 0 0 17 84 17 active+undersized+degraded 2026-02-17T11:20:20.535266+0000 45'101 45:141 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:37.556030+0000 0 0 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stdout:1.f 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534748+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444714+0000 0 0 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stdout:1.10 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535287+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444465+0000 0 0 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stdout:1.11 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534806+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444474+0000 0 0 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stdout:1.12 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534552+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444533+0000 0 0 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stdout:1.13 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534803+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444524+0000 0 0 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stdout:1.14 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534893+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444561+0000 0 0 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stdout:1.15 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535164+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444504+0000 0 0 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stdout:1.16 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534654+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444678+0000 0 0 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stdout:1.17 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534595+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444696+0000 0 0 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stdout:1.18 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534668+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444552+0000 0 0 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stdout:1.19 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535057+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444453+0000 0 0 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stdout:1.1a 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534988+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444493+0000 0 0 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stdout:1.1b 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534754+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444542+0000 0 0 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:21:04.283 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:21:04.292 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:763: TEST_divergent_3: for i in $non_divergent 2026-02-17T11:21:04.293 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: get_asok_path osd.0 2026-02-17T11:21:04.293 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T11:21:04.293 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T11:21:04.293 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:21:04.293 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:21:04.293 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:21:04.293 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.0.asok 2026-02-17T11:21:04.294 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: CEPH_ARGS= 2026-02-17T11:21:04.294 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.0.asok set_recovery_delay 100000 2026-02-17T11:21:04.359 INFO:tasks.workunit.client.0.trial148.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T11:21:04.365 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:763: TEST_divergent_3: for i in $non_divergent 2026-02-17T11:21:04.366 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: get_asok_path osd.2 2026-02-17T11:21:04.366 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2026-02-17T11:21:04.366 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2026-02-17T11:21:04.366 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:21:04.366 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:21:04.367 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:21:04.367 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.2.asok 2026-02-17T11:21:04.367 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: CEPH_ARGS= 2026-02-17T11:21:04.367 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.2.asok set_recovery_delay 100000 2026-02-17T11:21:04.420 INFO:tasks.workunit.client.0.trial148.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T11:21:04.426 INFO:tasks.workunit.client.0.trial148.stdout:revive divergent 1 2026-02-17T11:21:04.426 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:769: TEST_divergent_3: echo 'revive divergent 1' 2026-02-17T11:21:04.426 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:770: TEST_divergent_3: ceph pg dump pgs 2026-02-17T11:21:04.631 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:21:04.631 INFO:tasks.workunit.client.0.trial148.stdout:1.1f 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535289+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444687+0000 0 0 2026-02-17T11:21:04.631 INFO:tasks.workunit.client.0.trial148.stdout:1.1e 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535158+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444634+0000 0 0 2026-02-17T11:21:04.632 INFO:tasks.workunit.client.0.trial148.stdout:1.1d 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534901+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444484+0000 0 0 2026-02-17T11:21:04.632 INFO:tasks.workunit.client.0.trial148.stdout:1.b 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533702+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444624+0000 0 0 2026-02-17T11:21:04.632 INFO:tasks.workunit.client.0.trial148.stdout:1.a 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533669+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444651+0000 0 0 2026-02-17T11:21:04.632 INFO:tasks.workunit.client.0.trial148.stdout:1.9 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533725+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444570+0000 0 0 2026-02-17T11:21:04.632 INFO:tasks.workunit.client.0.trial148.stdout:1.8 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533667+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444579+0000 0 0 2026-02-17T11:21:04.632 INFO:tasks.workunit.client.0.trial148.stdout:1.7 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535004+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444724+0000 0 0 2026-02-17T11:21:04.632 INFO:tasks.workunit.client.0.trial148.stdout:1.6 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534716+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444705+0000 0 0 2026-02-17T11:21:04.632 INFO:tasks.workunit.client.0.trial148.stdout:1.5 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533622+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444597+0000 0 0 2026-02-17T11:21:04.632 INFO:tasks.workunit.client.0.trial148.stdout:1.4 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533612+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444669+0000 0 0 2026-02-17T11:21:04.632 INFO:tasks.workunit.client.0.trial148.stdout:1.3 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533558+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444642+0000 0 0 2026-02-17T11:21:04.633 INFO:tasks.workunit.client.0.trial148.stdout:1.2 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533725+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444615+0000 0 0 2026-02-17T11:21:04.633 INFO:tasks.workunit.client.0.trial148.stdout:1.c 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534661+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444606+0000 0 0 2026-02-17T11:21:04.633 INFO:tasks.workunit.client.0.trial148.stdout:1.1 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533554+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444661+0000 0 0 2026-02-17T11:21:04.633 INFO:tasks.workunit.client.0.trial148.stdout:1.1c 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535631+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444514+0000 0 0 2026-02-17T11:21:04.633 INFO:tasks.workunit.client.0.trial148.stdout:1.0 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533565+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444440+0000 0 0 2026-02-17T11:21:04.633 INFO:tasks.workunit.client.0.trial148.stdout:1.d 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534577+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444588+0000 0 0 2026-02-17T11:21:04.633 INFO:tasks.workunit.client.0.trial148.stdout:1.e 3 0 3 0 0 2444 0 0 17 84 17 active+undersized+degraded 2026-02-17T11:20:20.535266+0000 45'101 45:141 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:37.556030+0000 0 0 2026-02-17T11:21:04.633 INFO:tasks.workunit.client.0.trial148.stdout:1.f 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534748+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444714+0000 0 0 2026-02-17T11:21:04.633 INFO:tasks.workunit.client.0.trial148.stdout:1.10 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535287+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444465+0000 0 0 2026-02-17T11:21:04.633 INFO:tasks.workunit.client.0.trial148.stdout:1.11 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534806+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444474+0000 0 0 2026-02-17T11:21:04.633 INFO:tasks.workunit.client.0.trial148.stdout:1.12 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534552+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444533+0000 0 0 2026-02-17T11:21:04.634 INFO:tasks.workunit.client.0.trial148.stdout:1.13 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534803+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444524+0000 0 0 2026-02-17T11:21:04.634 INFO:tasks.workunit.client.0.trial148.stdout:1.14 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534893+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444561+0000 0 0 2026-02-17T11:21:04.634 INFO:tasks.workunit.client.0.trial148.stdout:1.15 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535164+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444504+0000 0 0 2026-02-17T11:21:04.634 INFO:tasks.workunit.client.0.trial148.stdout:1.16 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534654+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444678+0000 0 0 2026-02-17T11:21:04.634 INFO:tasks.workunit.client.0.trial148.stdout:1.17 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534595+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444696+0000 0 0 2026-02-17T11:21:04.634 INFO:tasks.workunit.client.0.trial148.stdout:1.18 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534668+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444552+0000 0 0 2026-02-17T11:21:04.634 INFO:tasks.workunit.client.0.trial148.stdout:1.19 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535057+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444453+0000 0 0 2026-02-17T11:21:04.634 INFO:tasks.workunit.client.0.trial148.stdout:1.1a 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534988+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444493+0000 0 0 2026-02-17T11:21:04.634 INFO:tasks.workunit.client.0.trial148.stdout:1.1b 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534754+0000 29'100 45:140 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:20:21.444542+0000 0 0 2026-02-17T11:21:04.634 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:21:04.634 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:21:04.635 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:21:04.640 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:771: TEST_divergent_3: ceph osd set noup 2026-02-17T11:21:04.938 INFO:tasks.workunit.client.0.trial148.stderr:noup is set 2026-02-17T11:21:04.954 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:772: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-17T11:21:04.954 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/divergent-priors 2026-02-17T11:21:04.954 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:21:04.954 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T11:21:04.954 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:21:04.955 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T11:21:04.955 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:21:04.955 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:21:04.955 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:21:04.955 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:21:04.955 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T11:21:04.955 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T11:21:04.955 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:21:04.955 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:21:04.955 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:21:04.955 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:21:04.955 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:21:04.956 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:21:04.956 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:21:04.956 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:21:04.956 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:21:04.956 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:21:04.956 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:21:04.956 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:21:04.956 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:21:04.956 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:21:04.956 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:21:04.956 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:21:04.956 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:21:04.957 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:21:04.957 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:21:04.957 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:21:04.957 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T11:21:04.957 INFO:tasks.workunit.client.0.trial148.stdout:start osd.1 2026-02-17T11:21:04.958 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T11:21:04.959 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:21:04.959 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T11:21:04.959 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T11:21:04.959 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:21:04.959 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:21:04.959 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:21:04.980 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:04.972+0000 7f4310ae68c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:21:04.981 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:04.976+0000 7f4310ae68c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:21:04.983 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:04.976+0000 7f4310ae68c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:21:05.164 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:880: activate_osd: return 0 2026-02-17T11:21:05.164 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:773: TEST_divergent_3: sleep 5 2026-02-17T11:21:06.246 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:06.240+0000 7f4310ae68c0 -1 Falling back to public interface 2026-02-17T11:21:09.285 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:09.280+0000 7f4310ae68c0 -1 osd.1 29 log_to_monitors true 2026-02-17T11:21:10.165 INFO:tasks.workunit.client.0.trial148.stdout:delay recovery divergent 2026-02-17T11:21:10.166 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:775: TEST_divergent_3: echo 'delay recovery divergent' 2026-02-17T11:21:10.166 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:776: TEST_divergent_3: ceph pg dump pgs 2026-02-17T11:21:10.358 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:21:10.358 INFO:tasks.workunit.client.0.trial148.stdout:1.1f 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535289+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565665+0000 0 0 2026-02-17T11:21:10.358 INFO:tasks.workunit.client.0.trial148.stdout:1.1e 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535158+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565625+0000 0 0 2026-02-17T11:21:10.358 INFO:tasks.workunit.client.0.trial148.stdout:1.1d 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534901+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565505+0000 0 0 2026-02-17T11:21:10.359 INFO:tasks.workunit.client.0.trial148.stdout:1.b 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533702+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565618+0000 0 0 2026-02-17T11:21:10.359 INFO:tasks.workunit.client.0.trial148.stdout:1.a 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533669+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565638+0000 0 0 2026-02-17T11:21:10.359 INFO:tasks.workunit.client.0.trial148.stdout:1.9 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533725+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565574+0000 0 0 2026-02-17T11:21:10.359 INFO:tasks.workunit.client.0.trial148.stdout:1.8 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533667+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565581+0000 0 0 2026-02-17T11:21:10.359 INFO:tasks.workunit.client.0.trial148.stdout:1.7 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535004+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565694+0000 0 0 2026-02-17T11:21:10.359 INFO:tasks.workunit.client.0.trial148.stdout:1.6 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534716+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565679+0000 0 0 2026-02-17T11:21:10.359 INFO:tasks.workunit.client.0.trial148.stdout:1.5 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533622+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565597+0000 0 0 2026-02-17T11:21:10.359 INFO:tasks.workunit.client.0.trial148.stdout:1.4 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533612+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565652+0000 0 0 2026-02-17T11:21:10.359 INFO:tasks.workunit.client.0.trial148.stdout:1.3 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533558+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565632+0000 0 0 2026-02-17T11:21:10.359 INFO:tasks.workunit.client.0.trial148.stdout:1.2 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533725+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565611+0000 0 0 2026-02-17T11:21:10.359 INFO:tasks.workunit.client.0.trial148.stdout:1.c 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534661+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565604+0000 0 0 2026-02-17T11:21:10.360 INFO:tasks.workunit.client.0.trial148.stdout:1.1 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533554+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565645+0000 0 0 2026-02-17T11:21:10.360 INFO:tasks.workunit.client.0.trial148.stdout:1.1c 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535631+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565528+0000 0 0 2026-02-17T11:21:10.360 INFO:tasks.workunit.client.0.trial148.stdout:1.0 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533565+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565470+0000 0 0 2026-02-17T11:21:10.360 INFO:tasks.workunit.client.0.trial148.stdout:1.d 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534577+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565588+0000 0 0 2026-02-17T11:21:10.360 INFO:tasks.workunit.client.0.trial148.stdout:1.e 3 0 3 0 0 2444 0 0 17 84 17 active+undersized+degraded 2026-02-17T11:20:20.535266+0000 45'101 47:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565701+0000 0 0 2026-02-17T11:21:10.360 INFO:tasks.workunit.client.0.trial148.stdout:1.f 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534748+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565686+0000 0 0 2026-02-17T11:21:10.360 INFO:tasks.workunit.client.0.trial148.stdout:1.10 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535287+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565490+0000 0 0 2026-02-17T11:21:10.360 INFO:tasks.workunit.client.0.trial148.stdout:1.11 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534806+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565498+0000 0 0 2026-02-17T11:21:10.360 INFO:tasks.workunit.client.0.trial148.stdout:1.12 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534552+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565543+0000 0 0 2026-02-17T11:21:10.360 INFO:tasks.workunit.client.0.trial148.stdout:1.13 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534803+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565536+0000 0 0 2026-02-17T11:21:10.360 INFO:tasks.workunit.client.0.trial148.stdout:1.14 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534893+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565566+0000 0 0 2026-02-17T11:21:10.361 INFO:tasks.workunit.client.0.trial148.stdout:1.15 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535164+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565521+0000 0 0 2026-02-17T11:21:10.361 INFO:tasks.workunit.client.0.trial148.stdout:1.16 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534654+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565659+0000 0 0 2026-02-17T11:21:10.361 INFO:tasks.workunit.client.0.trial148.stdout:1.17 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534595+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565672+0000 0 0 2026-02-17T11:21:10.361 INFO:tasks.workunit.client.0.trial148.stdout:1.18 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534668+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565559+0000 0 0 2026-02-17T11:21:10.361 INFO:tasks.workunit.client.0.trial148.stdout:1.19 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535057+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565480+0000 0 0 2026-02-17T11:21:10.361 INFO:tasks.workunit.client.0.trial148.stdout:1.1a 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534988+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565512+0000 0 0 2026-02-17T11:21:10.361 INFO:tasks.workunit.client.0.trial148.stdout:1.1b 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534754+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565551+0000 0 0 2026-02-17T11:21:10.361 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:21:10.361 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:21:10.362 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:21:10.367 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:777: TEST_divergent_3: get_asok_path osd.1 2026-02-17T11:21:10.367 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T11:21:10.367 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T11:21:10.368 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:21:10.368 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:21:10.368 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:21:10.368 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.1.asok 2026-02-17T11:21:10.368 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:777: TEST_divergent_3: CEPH_ARGS= 2026-02-17T11:21:10.368 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:777: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.1.asok set_recovery_delay 100000 2026-02-17T11:21:10.422 INFO:tasks.workunit.client.0.trial148.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T11:21:10.427 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: ceph osd unset noup 2026-02-17T11:21:10.748 INFO:tasks.workunit.client.0.trial148.stderr:noup is unset 2026-02-17T11:21:10.760 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:781: TEST_divergent_3: wait_for_osd up 0 2026-02-17T11:21:10.760 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:21:10.760 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T11:21:10.760 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:21:10.761 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:21:10.761 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:21:10.761 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:21:10.762 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:21:10.762 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:21:10.762 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:21:10.976 INFO:tasks.workunit.client.0.trial148.stdout:osd.0 up in weight 1 up_from 36 up_thru 44 down_at 30 last_clean_interval [5,29) [v2:127.0.0.1:6802/3809649686,v1:127.0.0.1:6803/3809649686] [v2:127.0.0.1:6804/3809649686,v1:127.0.0.1:6805/3809649686] exists,up 445c6994-5669-4311-9e55-f2c103270e94 2026-02-17T11:21:10.977 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:21:10.977 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:21:10.977 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:21:10.977 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:782: TEST_divergent_3: wait_for_osd up 1 2026-02-17T11:21:10.977 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:21:10.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T11:21:10.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:21:10.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:21:10.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:21:10.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:21:10.978 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:21:10.979 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:21:10.979 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:21:11.181 INFO:tasks.workunit.client.0.trial148.stdout:osd.1 up in weight 1 up_from 50 up_thru 50 down_at 31 last_clean_interval [10,29) [v2:127.0.0.1:6818/521973811,v1:127.0.0.1:6819/521973811] [v2:127.0.0.1:6820/521973811,v1:127.0.0.1:6821/521973811] exists,up 2c40e141-b07b-4dad-aaf4-9c213ae159a3 2026-02-17T11:21:11.182 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:21:11.183 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:21:11.183 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:21:11.183 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:783: TEST_divergent_3: wait_for_osd up 2 2026-02-17T11:21:11.183 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:21:11.183 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T11:21:11.183 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:21:11.183 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:21:11.184 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:21:11.184 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:21:11.184 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:21:11.184 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:21:11.184 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:21:11.383 INFO:tasks.workunit.client.0.trial148.stdout:osd.2 up in weight 1 up_from 39 up_thru 0 down_at 32 last_clean_interval [14,29) [v2:127.0.0.1:6810/3194056430,v1:127.0.0.1:6811/3194056430] [v2:127.0.0.1:6812/3194056430,v1:127.0.0.1:6813/3194056430] exists,up 2dfcc774-bf64-4f70-a754-84bb2859cd23 2026-02-17T11:21:11.384 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:21:11.384 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:21:11.384 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:21:11.384 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:785: TEST_divergent_3: ceph pg dump pgs 2026-02-17T11:21:11.577 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:21:11.577 INFO:tasks.workunit.client.0.trial148.stdout:1.1f 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535289+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565665+0000 0 0 2026-02-17T11:21:11.578 INFO:tasks.workunit.client.0.trial148.stdout:1.1e 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535158+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565625+0000 0 0 2026-02-17T11:21:11.578 INFO:tasks.workunit.client.0.trial148.stdout:1.1d 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534901+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565505+0000 0 0 2026-02-17T11:21:11.578 INFO:tasks.workunit.client.0.trial148.stdout:1.b 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533702+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565618+0000 0 0 2026-02-17T11:21:11.578 INFO:tasks.workunit.client.0.trial148.stdout:1.a 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533669+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565638+0000 0 0 2026-02-17T11:21:11.578 INFO:tasks.workunit.client.0.trial148.stdout:1.9 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533725+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565574+0000 0 0 2026-02-17T11:21:11.578 INFO:tasks.workunit.client.0.trial148.stdout:1.8 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533667+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565581+0000 0 0 2026-02-17T11:21:11.578 INFO:tasks.workunit.client.0.trial148.stdout:1.7 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535004+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565694+0000 0 0 2026-02-17T11:21:11.578 INFO:tasks.workunit.client.0.trial148.stdout:1.6 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534716+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565679+0000 0 0 2026-02-17T11:21:11.578 INFO:tasks.workunit.client.0.trial148.stdout:1.5 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533622+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565597+0000 0 0 2026-02-17T11:21:11.578 INFO:tasks.workunit.client.0.trial148.stdout:1.4 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533612+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565652+0000 0 0 2026-02-17T11:21:11.579 INFO:tasks.workunit.client.0.trial148.stdout:1.3 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533558+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565632+0000 0 0 2026-02-17T11:21:11.579 INFO:tasks.workunit.client.0.trial148.stdout:1.2 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533725+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565611+0000 0 0 2026-02-17T11:21:11.579 INFO:tasks.workunit.client.0.trial148.stdout:1.c 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534661+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565604+0000 0 0 2026-02-17T11:21:11.579 INFO:tasks.workunit.client.0.trial148.stdout:1.1 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533554+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565645+0000 0 0 2026-02-17T11:21:11.579 INFO:tasks.workunit.client.0.trial148.stdout:1.1c 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535631+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565528+0000 0 0 2026-02-17T11:21:11.579 INFO:tasks.workunit.client.0.trial148.stdout:1.0 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533565+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565470+0000 0 0 2026-02-17T11:21:11.579 INFO:tasks.workunit.client.0.trial148.stdout:1.d 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534577+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565588+0000 0 0 2026-02-17T11:21:11.579 INFO:tasks.workunit.client.0.trial148.stdout:1.e 3 0 3 0 0 2444 0 0 17 84 17 active+undersized+degraded 2026-02-17T11:20:20.535266+0000 45'101 47:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565701+0000 0 0 2026-02-17T11:21:11.579 INFO:tasks.workunit.client.0.trial148.stdout:1.f 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534748+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565686+0000 0 0 2026-02-17T11:21:11.579 INFO:tasks.workunit.client.0.trial148.stdout:1.10 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535287+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565490+0000 0 0 2026-02-17T11:21:11.579 INFO:tasks.workunit.client.0.trial148.stdout:1.11 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534806+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565498+0000 0 0 2026-02-17T11:21:11.579 INFO:tasks.workunit.client.0.trial148.stdout:1.12 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534552+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565543+0000 0 0 2026-02-17T11:21:11.580 INFO:tasks.workunit.client.0.trial148.stdout:1.13 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534803+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565536+0000 0 0 2026-02-17T11:21:11.580 INFO:tasks.workunit.client.0.trial148.stdout:1.14 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534893+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565566+0000 0 0 2026-02-17T11:21:11.580 INFO:tasks.workunit.client.0.trial148.stdout:1.15 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535164+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565521+0000 0 0 2026-02-17T11:21:11.580 INFO:tasks.workunit.client.0.trial148.stdout:1.16 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534654+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565659+0000 0 0 2026-02-17T11:21:11.580 INFO:tasks.workunit.client.0.trial148.stdout:1.17 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534595+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565672+0000 0 0 2026-02-17T11:21:11.580 INFO:tasks.workunit.client.0.trial148.stdout:1.18 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534668+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565559+0000 0 0 2026-02-17T11:21:11.580 INFO:tasks.workunit.client.0.trial148.stdout:1.19 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535057+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565480+0000 0 0 2026-02-17T11:21:11.580 INFO:tasks.workunit.client.0.trial148.stdout:1.1a 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534988+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565512+0000 0 0 2026-02-17T11:21:11.580 INFO:tasks.workunit.client.0.trial148.stdout:1.1b 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534754+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565551+0000 0 0 2026-02-17T11:21:11.580 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:21:11.580 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:21:11.581 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:21:11.586 INFO:tasks.workunit.client.0.trial148.stdout:wait for peering 2026-02-17T11:21:11.586 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:786: TEST_divergent_3: echo 'wait for peering' 2026-02-17T11:21:11.586 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:787: TEST_divergent_3: ceph pg dump pgs 2026-02-17T11:21:11.793 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:21:11.794 INFO:tasks.workunit.client.0.trial148.stdout:1.1f 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535289+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565665+0000 0 0 2026-02-17T11:21:11.794 INFO:tasks.workunit.client.0.trial148.stdout:1.1e 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535158+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565625+0000 0 0 2026-02-17T11:21:11.794 INFO:tasks.workunit.client.0.trial148.stdout:1.1d 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534901+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565505+0000 0 0 2026-02-17T11:21:11.794 INFO:tasks.workunit.client.0.trial148.stdout:1.b 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533702+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565618+0000 0 0 2026-02-17T11:21:11.794 INFO:tasks.workunit.client.0.trial148.stdout:1.a 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533669+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565638+0000 0 0 2026-02-17T11:21:11.794 INFO:tasks.workunit.client.0.trial148.stdout:1.9 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533725+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565574+0000 0 0 2026-02-17T11:21:11.794 INFO:tasks.workunit.client.0.trial148.stdout:1.8 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533667+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565581+0000 0 0 2026-02-17T11:21:11.794 INFO:tasks.workunit.client.0.trial148.stdout:1.7 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535004+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565694+0000 0 0 2026-02-17T11:21:11.794 INFO:tasks.workunit.client.0.trial148.stdout:1.6 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534716+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565679+0000 0 0 2026-02-17T11:21:11.794 INFO:tasks.workunit.client.0.trial148.stdout:1.5 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533622+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565597+0000 0 0 2026-02-17T11:21:11.794 INFO:tasks.workunit.client.0.trial148.stdout:1.4 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533612+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565652+0000 0 0 2026-02-17T11:21:11.795 INFO:tasks.workunit.client.0.trial148.stdout:1.3 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533558+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565632+0000 0 0 2026-02-17T11:21:11.795 INFO:tasks.workunit.client.0.trial148.stdout:1.2 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533725+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565611+0000 0 0 2026-02-17T11:21:11.795 INFO:tasks.workunit.client.0.trial148.stdout:1.c 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534661+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565604+0000 0 0 2026-02-17T11:21:11.795 INFO:tasks.workunit.client.0.trial148.stdout:1.1 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533554+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565645+0000 0 0 2026-02-17T11:21:11.795 INFO:tasks.workunit.client.0.trial148.stdout:1.1c 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535631+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565528+0000 0 0 2026-02-17T11:21:11.795 INFO:tasks.workunit.client.0.trial148.stdout:1.0 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533565+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565470+0000 0 0 2026-02-17T11:21:11.795 INFO:tasks.workunit.client.0.trial148.stdout:1.d 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534577+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565588+0000 0 0 2026-02-17T11:21:11.795 INFO:tasks.workunit.client.0.trial148.stdout:1.e 3 0 3 0 0 2444 0 0 17 84 17 active+undersized+degraded 2026-02-17T11:20:20.535266+0000 45'101 47:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565701+0000 0 0 2026-02-17T11:21:11.795 INFO:tasks.workunit.client.0.trial148.stdout:1.f 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534748+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565686+0000 0 0 2026-02-17T11:21:11.795 INFO:tasks.workunit.client.0.trial148.stdout:1.10 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535287+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565490+0000 0 0 2026-02-17T11:21:11.795 INFO:tasks.workunit.client.0.trial148.stdout:1.11 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534806+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565498+0000 0 0 2026-02-17T11:21:11.796 INFO:tasks.workunit.client.0.trial148.stdout:1.12 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534552+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565543+0000 0 0 2026-02-17T11:21:11.796 INFO:tasks.workunit.client.0.trial148.stdout:1.13 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534803+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565536+0000 0 0 2026-02-17T11:21:11.796 INFO:tasks.workunit.client.0.trial148.stdout:1.14 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534893+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565566+0000 0 0 2026-02-17T11:21:11.796 INFO:tasks.workunit.client.0.trial148.stdout:1.15 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535164+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565521+0000 0 0 2026-02-17T11:21:11.796 INFO:tasks.workunit.client.0.trial148.stdout:1.16 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534654+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565659+0000 0 0 2026-02-17T11:21:11.796 INFO:tasks.workunit.client.0.trial148.stdout:1.17 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534595+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565672+0000 0 0 2026-02-17T11:21:11.796 INFO:tasks.workunit.client.0.trial148.stdout:1.18 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534668+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565559+0000 0 0 2026-02-17T11:21:11.796 INFO:tasks.workunit.client.0.trial148.stdout:1.19 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535057+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565480+0000 0 0 2026-02-17T11:21:11.796 INFO:tasks.workunit.client.0.trial148.stdout:1.1a 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534988+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565512+0000 0 0 2026-02-17T11:21:11.796 INFO:tasks.workunit.client.0.trial148.stdout:1.1b 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534754+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565551+0000 0 0 2026-02-17T11:21:11.796 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:21:11.796 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:21:11.797 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:21:11.802 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:788: TEST_divergent_3: rados -p test put foo /etc/fstab 2026-02-17T11:21:11.833 INFO:tasks.workunit.client.0.trial148.stdout:killing divergent 1 2026-02-17T11:21:11.834 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:792: TEST_divergent_3: echo 'killing divergent 1' 2026-02-17T11:21:11.834 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:793: TEST_divergent_3: ceph pg dump pgs 2026-02-17T11:21:12.029 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:21:12.029 INFO:tasks.workunit.client.0.trial148.stdout:1.1f 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535289+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565665+0000 0 0 2026-02-17T11:21:12.029 INFO:tasks.workunit.client.0.trial148.stdout:1.1e 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535158+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565625+0000 0 0 2026-02-17T11:21:12.029 INFO:tasks.workunit.client.0.trial148.stdout:1.1d 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534901+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565505+0000 0 0 2026-02-17T11:21:12.029 INFO:tasks.workunit.client.0.trial148.stdout:1.b 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533702+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565618+0000 0 0 2026-02-17T11:21:12.029 INFO:tasks.workunit.client.0.trial148.stdout:1.a 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533669+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565638+0000 0 0 2026-02-17T11:21:12.029 INFO:tasks.workunit.client.0.trial148.stdout:1.9 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533725+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565574+0000 0 0 2026-02-17T11:21:12.030 INFO:tasks.workunit.client.0.trial148.stdout:1.8 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533667+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565581+0000 0 0 2026-02-17T11:21:12.030 INFO:tasks.workunit.client.0.trial148.stdout:1.7 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535004+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565694+0000 0 0 2026-02-17T11:21:12.030 INFO:tasks.workunit.client.0.trial148.stdout:1.6 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534716+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565679+0000 0 0 2026-02-17T11:21:12.030 INFO:tasks.workunit.client.0.trial148.stdout:1.5 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533622+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565597+0000 0 0 2026-02-17T11:21:12.030 INFO:tasks.workunit.client.0.trial148.stdout:1.4 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533612+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565652+0000 0 0 2026-02-17T11:21:12.030 INFO:tasks.workunit.client.0.trial148.stdout:1.3 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533558+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565632+0000 0 0 2026-02-17T11:21:12.030 INFO:tasks.workunit.client.0.trial148.stdout:1.2 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533725+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565611+0000 0 0 2026-02-17T11:21:12.030 INFO:tasks.workunit.client.0.trial148.stdout:1.c 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534661+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565604+0000 0 0 2026-02-17T11:21:12.030 INFO:tasks.workunit.client.0.trial148.stdout:1.1 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533554+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565645+0000 0 0 2026-02-17T11:21:12.030 INFO:tasks.workunit.client.0.trial148.stdout:1.1c 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535631+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565528+0000 0 0 2026-02-17T11:21:12.031 INFO:tasks.workunit.client.0.trial148.stdout:1.0 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533565+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565470+0000 0 0 2026-02-17T11:21:12.031 INFO:tasks.workunit.client.0.trial148.stdout:1.d 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534577+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565588+0000 0 0 2026-02-17T11:21:12.031 INFO:tasks.workunit.client.0.trial148.stdout:1.e 3 0 3 0 0 2444 0 0 17 84 17 active+undersized+degraded 2026-02-17T11:20:20.535266+0000 45'101 47:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565701+0000 0 0 2026-02-17T11:21:12.031 INFO:tasks.workunit.client.0.trial148.stdout:1.f 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534748+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565686+0000 0 0 2026-02-17T11:21:12.031 INFO:tasks.workunit.client.0.trial148.stdout:1.10 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535287+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565490+0000 0 0 2026-02-17T11:21:12.031 INFO:tasks.workunit.client.0.trial148.stdout:1.11 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534806+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565498+0000 0 0 2026-02-17T11:21:12.031 INFO:tasks.workunit.client.0.trial148.stdout:1.12 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534552+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565543+0000 0 0 2026-02-17T11:21:12.031 INFO:tasks.workunit.client.0.trial148.stdout:1.13 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534803+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565536+0000 0 0 2026-02-17T11:21:12.031 INFO:tasks.workunit.client.0.trial148.stdout:1.14 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534893+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565566+0000 0 0 2026-02-17T11:21:12.031 INFO:tasks.workunit.client.0.trial148.stdout:1.15 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535164+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565521+0000 0 0 2026-02-17T11:21:12.032 INFO:tasks.workunit.client.0.trial148.stdout:1.16 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534654+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565659+0000 0 0 2026-02-17T11:21:12.032 INFO:tasks.workunit.client.0.trial148.stdout:1.17 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534595+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565672+0000 0 0 2026-02-17T11:21:12.032 INFO:tasks.workunit.client.0.trial148.stdout:1.18 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534668+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565559+0000 0 0 2026-02-17T11:21:12.032 INFO:tasks.workunit.client.0.trial148.stdout:1.19 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535057+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565480+0000 0 0 2026-02-17T11:21:12.032 INFO:tasks.workunit.client.0.trial148.stdout:1.1a 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534988+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565512+0000 0 0 2026-02-17T11:21:12.032 INFO:tasks.workunit.client.0.trial148.stdout:1.1b 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534754+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565551+0000 0 0 2026-02-17T11:21:12.032 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:21:12.032 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:21:12.033 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:21:12.038 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:794: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd.1 2026-02-17T11:21:12.040 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:21:12.040 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:21:12.040 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:21:12.040 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:21:12.040 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:21:12.147 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:21:12.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:797: TEST_divergent_3: expfile=td/divergent-priors/exp.19803.out 2026-02-17T11:21:12.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:798: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.19803.out 2026-02-17T11:21:12.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T11:21:12.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T11:21:12.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=1 2026-02-17T11:21:12.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T11:21:12.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T11:21:12.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.19803.out 2026-02-17T11:21:12.799 INFO:tasks.workunit.client.0.trial148.stderr:Exporting 1.0 info 1.0( v 29'100 (29'90,29'100] local-lis/les=50/51 n=3 ec=21/21 lis/c=50/50 les/c/f=51/51/0 sis=50) 2026-02-17T11:21:12.800 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-17T11:21:12.801 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-17T11:21:12.801 INFO:tasks.workunit.client.0.trial148.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-17T11:21:12.801 INFO:tasks.workunit.client.0.trial148.stderr:Export successful 2026-02-17T11:21:12.801 INFO:tasks.workunit.client.0.trial148.stdout: marking collection for removal 2026-02-17T11:21:12.801 INFO:tasks.workunit.client.0.trial148.stdout:setting '_remove' omap key 2026-02-17T11:21:12.802 INFO:tasks.workunit.client.0.trial148.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-17T11:21:12.802 INFO:tasks.workunit.client.0.trial148.stderr:Remove successful 2026-02-17T11:21:13.342 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:799: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.19803.out 2026-02-17T11:21:13.342 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T11:21:13.342 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T11:21:13.342 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=1 2026-02-17T11:21:13.342 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T11:21:13.342 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T11:21:13.342 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.19803.out 2026-02-17T11:21:13.979 INFO:tasks.workunit.client.0.trial148.stdout:get_pg_num_history pg_num_history pg_num_history(e52 pg_nums {1={21=1,40=32}} deleted_pools ) 2026-02-17T11:21:13.979 INFO:tasks.workunit.client.0.trial148.stdout:Importing pgid 1.0 2026-02-17T11:21:13.979 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-17T11:21:13.979 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:21:13.979 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-17T11:21:13.979 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:21:13.980 INFO:tasks.workunit.client.0.trial148.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-17T11:21:13.980 INFO:tasks.workunit.client.0.trial148.stdout:snapset 0=[]:{} 2026-02-17T11:21:13.980 INFO:tasks.workunit.client.0.trial148.stdout:write_pg epoch 51 info 1.0( v 29'100 (29'90,29'100] local-lis/les=50/51 n=3 ec=21/21 lis/c=50/50 les/c/f=51/51/0 sis=50) 2026-02-17T11:21:13.981 INFO:tasks.workunit.client.0.trial148.stdout:Import successful 2026-02-17T11:21:14.514 INFO:tasks.workunit.client.0.trial148.stdout:reviving divergent 1 2026-02-17T11:21:14.514 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:801: TEST_divergent_3: echo 'reviving divergent 1' 2026-02-17T11:21:14.514 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:802: TEST_divergent_3: ceph pg dump pgs 2026-02-17T11:21:14.700 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:21:14.700 INFO:tasks.workunit.client.0.trial148.stdout:1.1f 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535289+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565665+0000 0 0 2026-02-17T11:21:14.700 INFO:tasks.workunit.client.0.trial148.stdout:1.1e 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535158+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565625+0000 0 0 2026-02-17T11:21:14.700 INFO:tasks.workunit.client.0.trial148.stdout:1.1d 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534901+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565505+0000 0 0 2026-02-17T11:21:14.700 INFO:tasks.workunit.client.0.trial148.stdout:1.b 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533702+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565618+0000 0 0 2026-02-17T11:21:14.701 INFO:tasks.workunit.client.0.trial148.stdout:1.a 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533669+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565638+0000 0 0 2026-02-17T11:21:14.701 INFO:tasks.workunit.client.0.trial148.stdout:1.9 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533725+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565574+0000 0 0 2026-02-17T11:21:14.701 INFO:tasks.workunit.client.0.trial148.stdout:1.8 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533667+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565581+0000 0 0 2026-02-17T11:21:14.701 INFO:tasks.workunit.client.0.trial148.stdout:1.7 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535004+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565694+0000 0 0 2026-02-17T11:21:14.701 INFO:tasks.workunit.client.0.trial148.stdout:1.6 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534716+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565679+0000 0 0 2026-02-17T11:21:14.701 INFO:tasks.workunit.client.0.trial148.stdout:1.5 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533622+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565597+0000 0 0 2026-02-17T11:21:14.701 INFO:tasks.workunit.client.0.trial148.stdout:1.4 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533612+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565652+0000 0 0 2026-02-17T11:21:14.701 INFO:tasks.workunit.client.0.trial148.stdout:1.3 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533558+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565632+0000 0 0 2026-02-17T11:21:14.701 INFO:tasks.workunit.client.0.trial148.stdout:1.2 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533725+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565611+0000 0 0 2026-02-17T11:21:14.701 INFO:tasks.workunit.client.0.trial148.stdout:1.c 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534661+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565604+0000 0 0 2026-02-17T11:21:14.701 INFO:tasks.workunit.client.0.trial148.stdout:1.1 4 0 4 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533554+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565645+0000 0 0 2026-02-17T11:21:14.701 INFO:tasks.workunit.client.0.trial148.stdout:1.1c 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535631+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565528+0000 0 0 2026-02-17T11:21:14.702 INFO:tasks.workunit.client.0.trial148.stdout:1.0 3 0 3 0 0 2171 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.533565+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565470+0000 0 0 2026-02-17T11:21:14.702 INFO:tasks.workunit.client.0.trial148.stdout:1.d 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534577+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565588+0000 0 0 2026-02-17T11:21:14.702 INFO:tasks.workunit.client.0.trial148.stdout:1.e 3 0 3 0 0 2444 0 0 17 84 17 active+undersized+degraded 2026-02-17T11:20:20.535266+0000 45'101 47:145 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565701+0000 0 0 2026-02-17T11:21:14.702 INFO:tasks.workunit.client.0.trial148.stdout:1.f 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534748+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565686+0000 0 0 2026-02-17T11:21:14.702 INFO:tasks.workunit.client.0.trial148.stdout:1.10 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535287+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565490+0000 0 0 2026-02-17T11:21:14.702 INFO:tasks.workunit.client.0.trial148.stdout:1.11 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534806+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565498+0000 0 0 2026-02-17T11:21:14.702 INFO:tasks.workunit.client.0.trial148.stdout:1.12 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534552+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565543+0000 0 0 2026-02-17T11:21:14.702 INFO:tasks.workunit.client.0.trial148.stdout:1.13 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534803+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565536+0000 0 0 2026-02-17T11:21:14.702 INFO:tasks.workunit.client.0.trial148.stdout:1.14 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534893+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565566+0000 0 0 2026-02-17T11:21:14.702 INFO:tasks.workunit.client.0.trial148.stdout:1.15 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535164+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565521+0000 0 0 2026-02-17T11:21:14.702 INFO:tasks.workunit.client.0.trial148.stdout:1.16 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534654+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565659+0000 0 0 2026-02-17T11:21:14.702 INFO:tasks.workunit.client.0.trial148.stdout:1.17 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534595+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565672+0000 0 0 2026-02-17T11:21:14.703 INFO:tasks.workunit.client.0.trial148.stdout:1.18 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534668+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565559+0000 0 0 2026-02-17T11:21:14.703 INFO:tasks.workunit.client.0.trial148.stdout:1.19 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.535057+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565480+0000 0 0 2026-02-17T11:21:14.703 INFO:tasks.workunit.client.0.trial148.stdout:1.1a 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534988+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565512+0000 0 0 2026-02-17T11:21:14.703 INFO:tasks.workunit.client.0.trial148.stdout:1.1b 3 0 3 0 0 2172 0 0 16 84 16 active+undersized+degraded 2026-02-17T11:20:20.534754+0000 29'100 47:144 [0,2] 0 [0,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-17T11:21:05.565551+0000 0 0 2026-02-17T11:21:14.703 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:21:14.703 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:21:14.703 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:21:14.710 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:803: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-17T11:21:14.710 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/divergent-priors 2026-02-17T11:21:14.710 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:21:14.710 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T11:21:14.710 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:21:14.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T11:21:14.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:21:14.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:21:14.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:21:14.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:21:14.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T11:21:14.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T11:21:14.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:21:14.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:21:14.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:21:14.711 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:21:14.711 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:21:14.712 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:21:14.712 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:21:14.712 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:21:14.712 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:21:14.712 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:21:14.713 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:21:14.713 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:21:14.713 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:21:14.713 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:21:14.713 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:21:14.713 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:21:14.713 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:21:14.713 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:21:14.714 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:21:14.714 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:21:14.714 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T11:21:14.714 INFO:tasks.workunit.client.0.trial148.stdout:start osd.1 2026-02-17T11:21:14.715 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T11:21:14.715 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:21:14.715 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T11:21:14.715 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T11:21:14.715 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:21:14.715 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:21:14.716 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:21:14.732 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:14.723+0000 7fd4913b18c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:21:14.733 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:14.727+0000 7fd4913b18c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:21:14.734 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:14.727+0000 7fd4913b18c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:21:14.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2026-02-17T11:21:14.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:21:14.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T11:21:14.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:21:14.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:21:14.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:21:14.922 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:21:14.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:21:14.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:21:14.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:21:15.119 INFO:tasks.workunit.client.0.trial148.stdout:osd.1 up in weight 1 up_from 50 up_thru 50 down_at 31 last_clean_interval [10,29) [v2:127.0.0.1:6818/521973811,v1:127.0.0.1:6819/521973811] [v2:127.0.0.1:6820/521973811,v1:127.0.0.1:6821/521973811] exists,up 2c40e141-b07b-4dad-aaf4-9c213ae159a3 2026-02-17T11:21:15.120 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:21:15.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:21:15.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:21:15.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:804: TEST_divergent_3: wait_for_osd up 1 2026-02-17T11:21:15.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:21:15.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T11:21:15.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:21:15.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:21:15.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:21:15.122 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:21:15.122 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:21:15.122 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:21:15.122 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:21:15.326 INFO:tasks.workunit.client.0.trial148.stdout:osd.1 up in weight 1 up_from 50 up_thru 50 down_at 31 last_clean_interval [10,29) [v2:127.0.0.1:6818/521973811,v1:127.0.0.1:6819/521973811] [v2:127.0.0.1:6820/521973811,v1:127.0.0.1:6821/521973811] exists,up 2c40e141-b07b-4dad-aaf4-9c213ae159a3 2026-02-17T11:21:15.326 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:21:15.327 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:21:15.327 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:21:15.327 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:806: TEST_divergent_3: sleep 20 2026-02-17T11:21:16.010 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:16.003+0000 7fd4913b18c0 -1 Falling back to public interface 2026-02-17T11:21:19.067 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:19.059+0000 7fd4913b18c0 -1 osd.1 52 log_to_monitors true 2026-02-17T11:21:35.329 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:807: TEST_divergent_3: get_asok_path osd.1 2026-02-17T11:21:35.329 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T11:21:35.330 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T11:21:35.330 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:21:35.330 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:21:35.330 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:21:35.330 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.1.asok 2026-02-17T11:21:35.330 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:807: TEST_divergent_3: CEPH_ARGS= 2026-02-17T11:21:35.331 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:807: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.1.asok dump_ops_in_flight 2026-02-17T11:21:35.382 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:21:35.382 INFO:tasks.workunit.client.0.trial148.stdout: "ops": [], 2026-02-17T11:21:35.382 INFO:tasks.workunit.client.0.trial148.stdout: "num_ops": 0 2026-02-17T11:21:35.382 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:21:35.387 INFO:tasks.workunit.client.0.trial148.stdout:allowing recovery 2026-02-17T11:21:35.388 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:809: TEST_divergent_3: echo 'allowing recovery' 2026-02-17T11:21:35.388 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:810: TEST_divergent_3: ceph pg dump pgs 2026-02-17T11:21:35.572 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:21:35.572 INFO:tasks.workunit.client.0.trial148.stdout:1.1f 3 0 0 0 0 2171 0 0 16 84 16 active+clean 2026-02-17T11:21:26.023354+0000 29'100 60:138 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.573 INFO:tasks.workunit.client.0.trial148.stdout:1.1e 3 0 0 0 0 2171 0 0 16 84 16 active+clean 2026-02-17T11:21:28.023916+0000 29'100 60:159 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.573 INFO:tasks.workunit.client.0.trial148.stdout:1.1d 3 0 0 0 0 2171 0 0 16 84 16 active+clean 2026-02-17T11:21:26.023971+0000 29'100 60:138 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.573 INFO:tasks.workunit.client.0.trial148.stdout:1.b 3 0 0 0 0 2172 0 0 16 84 16 active+clean 2026-02-17T11:21:26.023953+0000 29'100 60:138 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T11:21:25.128796+0000 29'100 2026-02-17T11:21:25.128796+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.573 INFO:tasks.workunit.client.0.trial148.stdout:1.a 3 0 0 0 0 2172 0 0 16 84 16 active+clean 2026-02-17T11:21:28.023595+0000 29'100 60:159 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-17T11:21:27.204114+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.573 INFO:tasks.workunit.client.0.trial148.stdout:1.9 3 0 0 0 0 2172 0 0 16 84 16 active+clean 2026-02-17T11:21:26.024402+0000 29'100 60:138 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.573 INFO:tasks.workunit.client.0.trial148.stdout:1.8 3 0 0 0 0 2085 0 0 10 90 10 active+clean 2026-02-17T11:21:28.243175+0000 29'100 60:171 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T11:21:28.243100+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T14:11:40.809196+0000 3 0 2026-02-17T11:21:35.573 INFO:tasks.workunit.client.0.trial148.stdout:1.7 3 0 0 0 0 2172 0 0 16 84 16 active+clean 2026-02-17T11:21:26.024077+0000 29'100 60:138 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.573 INFO:tasks.workunit.client.0.trial148.stdout:1.6 4 0 0 0 0 2867 0 0 17 84 17 active+clean 2026-02-17T11:21:28.023758+0000 52'101 60:154 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.573 INFO:tasks.workunit.client.0.trial148.stdout:1.5 3 0 0 0 0 2172 0 0 16 84 16 active+clean 2026-02-17T11:21:26.023267+0000 29'100 60:138 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.573 INFO:tasks.workunit.client.0.trial148.stdout:1.4 4 0 0 0 0 2172 0 0 16 84 16 active+clean 2026-02-17T11:21:19.454340+0000 29'100 60:162 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.573 INFO:tasks.workunit.client.0.trial148.stdout:1.3 4 0 0 0 0 2172 0 0 16 84 16 active+clean 2026-02-17T11:21:26.024004+0000 29'100 60:138 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.574 INFO:tasks.workunit.client.0.trial148.stdout:1.2 1 0 0 0 0 695 0 0 16 84 16 active+clean 2026-02-17T11:21:28.614700+0000 29'100 60:167 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-17T11:21:28.614627+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T15:44:48.763353+0000 1 0 2026-02-17T11:21:35.574 INFO:tasks.workunit.client.0.trial148.stdout:1.c 3 0 0 0 0 2172 0 0 14 86 14 active+clean 2026-02-17T11:21:19.454076+0000 29'100 60:163 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.574 INFO:tasks.workunit.client.0.trial148.stdout:1.1 4 0 0 0 0 2172 0 0 16 84 16 active+clean 2026-02-17T11:21:26.024144+0000 29'100 60:138 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.574 INFO:tasks.workunit.client.0.trial148.stdout:1.1c 2 0 0 0 0 1390 0 0 16 84 16 active+clean 2026-02-17T11:21:23.150122+0000 29'100 60:170 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T11:21:23.150044+0000 29'100 2026-02-17T11:21:23.150044+0000 0 0 periodic scrub scheduled @ 2026-02-18T15:21:01.016583+0000 2 0 2026-02-17T11:21:35.574 INFO:tasks.workunit.client.0.trial148.stdout:1.0 3 0 0 0 0 2085 0 0 10 90 10 active+clean 2026-02-17T11:21:20.124758+0000 29'100 60:171 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T11:21:20.124697+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T17:00:54.891039+0000 3 0 2026-02-17T11:21:35.574 INFO:tasks.workunit.client.0.trial148.stdout:1.d 3 0 0 0 0 2085 0 0 16 84 16 active+clean 2026-02-17T11:21:27.140128+0000 29'100 60:146 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T11:21:27.140050+0000 0'0 2026-02-17T11:19:27.671920+0000 0 1 periodic scrub scheduled @ 2026-02-18T15:42:59.805291+0000 3 0 2026-02-17T11:21:35.574 INFO:tasks.workunit.client.0.trial148.stdout:1.e 3 0 0 0 0 2444 0 0 17 84 17 active+clean 2026-02-17T11:21:28.023594+0000 45'101 60:160 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.574 INFO:tasks.workunit.client.0.trial148.stdout:1.f 3 0 0 0 0 2172 0 0 16 84 16 active+clean 2026-02-17T11:21:26.024116+0000 29'100 60:138 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.574 INFO:tasks.workunit.client.0.trial148.stdout:1.10 3 0 0 0 0 2085 0 0 10 90 10 active+clean 2026-02-17T11:21:21.139627+0000 29'100 60:171 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T11:21:21.139572+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T20:48:06.219194+0000 3 0 2026-02-17T11:21:35.574 INFO:tasks.workunit.client.0.trial148.stdout:1.11 3 0 0 0 0 2085 0 0 16 84 16 active+clean 2026-02-17T11:21:28.188590+0000 29'100 60:146 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T11:21:28.188352+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:23:09.889921+0000 3 0 2026-02-17T11:21:35.574 INFO:tasks.workunit.client.0.trial148.stdout:1.12 3 0 0 0 0 2172 0 0 16 84 16 active+clean 2026-02-17T11:21:28.023915+0000 29'100 60:159 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-17T11:21:26.158563+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.574 INFO:tasks.workunit.client.0.trial148.stdout:1.13 3 0 0 0 0 2172 0 0 16 84 16 active+clean 2026-02-17T11:21:26.023322+0000 29'100 60:138 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.575 INFO:tasks.workunit.client.0.trial148.stdout:1.14 3 0 0 0 0 2172 0 0 10 90 10 active+clean 2026-02-17T11:21:19.454377+0000 29'100 60:163 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.575 INFO:tasks.workunit.client.0.trial148.stdout:1.15 3 0 0 0 0 2085 0 0 16 84 16 active+clean 2026-02-17T11:21:26.135860+0000 29'100 60:146 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T11:21:26.135783+0000 29'100 2026-02-17T11:21:26.135783+0000 0 1 periodic scrub scheduled @ 2026-02-18T21:17:11.962653+0000 3 0 2026-02-17T11:21:35.575 INFO:tasks.workunit.client.0.trial148.stdout:1.16 3 0 0 0 0 2172 0 0 16 84 16 active+clean 2026-02-17T11:21:28.023956+0000 29'100 60:159 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.575 INFO:tasks.workunit.client.0.trial148.stdout:1.17 3 0 0 0 0 2172 0 0 16 84 16 active+clean 2026-02-17T11:21:26.023313+0000 29'100 60:138 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.575 INFO:tasks.workunit.client.0.trial148.stdout:1.18 3 0 0 0 0 2172 0 0 10 90 10 active+clean 2026-02-17T11:21:19.454134+0000 29'100 60:163 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.575 INFO:tasks.workunit.client.0.trial148.stdout:1.19 2 0 0 0 0 1390 0 0 16 84 16 active+clean 2026-02-17T11:21:29.224439+0000 29'100 60:146 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T11:21:29.224363+0000 29'100 2026-02-17T11:21:24.126413+0000 0 0 periodic scrub scheduled @ 2026-02-18T14:52:28.527843+0000 2 0 2026-02-17T11:21:35.575 INFO:tasks.workunit.client.0.trial148.stdout:1.1a 3 0 0 0 0 2172 0 0 16 84 16 active+clean 2026-02-17T11:21:28.023748+0000 29'100 60:159 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.575 INFO:tasks.workunit.client.0.trial148.stdout:1.1b 3 0 0 0 0 2172 0 0 16 84 16 active+clean 2026-02-17T11:21:26.023308+0000 29'100 60:138 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:35.575 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:21:35.575 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:21:35.576 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:21:35.580 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:812: TEST_divergent_3: for i in $osds 2026-02-17T11:21:35.581 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:814: TEST_divergent_3: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-17T11:21:35.647 INFO:tasks.workunit.client.0.trial148.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T11:21:35.654 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:812: TEST_divergent_3: for i in $osds 2026-02-17T11:21:35.654 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:814: TEST_divergent_3: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-17T11:21:35.735 INFO:tasks.workunit.client.0.trial148.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T11:21:35.743 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:812: TEST_divergent_3: for i in $osds 2026-02-17T11:21:35.743 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:814: TEST_divergent_3: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-17T11:21:35.822 INFO:tasks.workunit.client.0.trial148.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T11:21:35.829 INFO:tasks.workunit.client.0.trial148.stdout:reading divergent objects 2026-02-17T11:21:35.829 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:817: TEST_divergent_3: echo 'reading divergent objects' 2026-02-17T11:21:35.830 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph pg dump pgs 2026-02-17T11:21:36.019 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:21:36.019 INFO:tasks.workunit.client.0.trial148.stdout:1.1f 3 0 0 0 0 2171 0 0 16 84 16 active+clean 2026-02-17T11:21:30.023059+0000 29'100 63:165 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:36.020 INFO:tasks.workunit.client.0.trial148.stdout:1.1e 3 0 0 0 0 2171 0 0 16 84 16 active+clean 2026-02-17T11:21:28.023916+0000 29'100 64:170 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:36.020 INFO:tasks.workunit.client.0.trial148.stdout:1.1d 4 0 0 0 0 2780 0 0 16 84 16 active+clean 2026-02-17T11:21:32.264333+0000 29'100 64:157 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T11:21:32.264271+0000 29'100 2026-02-17T11:21:32.264271+0000 0 0 periodic scrub scheduled @ 2026-02-18T14:53:29.849872+0000 4 0 2026-02-17T11:21:36.020 INFO:tasks.workunit.client.0.trial148.stdout:1.b 3 0 0 0 0 2085 0 0 10 90 10 active+clean 2026-02-17T11:21:32.250505+0000 29'100 63:183 [1,2,0] 1 [1,2,0] 1 29'100 2026-02-17T11:21:32.250426+0000 29'100 2026-02-17T11:21:25.128796+0000 0 0 periodic scrub scheduled @ 2026-02-18T13:21:04.049248+0000 3 0 2026-02-17T11:21:36.020 INFO:tasks.workunit.client.0.trial148.stdout:1.a 3 0 0 0 0 2085 0 0 16 84 16 active+clean 2026-02-17T11:21:30.570442+0000 29'100 64:178 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-17T11:21:30.570384+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T13:51:39.492334+0000 3 0 2026-02-17T11:21:36.020 INFO:tasks.workunit.client.0.trial148.stdout:1.9 5 0 0 0 0 3475 0 0 16 84 16 active+clean 2026-02-17T11:21:30.200206+0000 29'100 64:157 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T11:21:30.200116+0000 0'0 2026-02-17T11:19:27.671920+0000 0 1 periodic scrub scheduled @ 2026-02-18T13:45:45.793888+0000 5 0 2026-02-17T11:21:36.020 INFO:tasks.workunit.client.0.trial148.stdout:1.8 3 0 0 0 0 2085 0 0 10 90 10 active+clean 2026-02-17T11:21:28.243175+0000 29'100 63:179 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T11:21:28.243100+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T15:29:17.707133+0000 3 0 2026-02-17T11:21:36.021 INFO:tasks.workunit.client.0.trial148.stdout:1.7 3 0 0 0 0 2172 0 0 16 84 16 active+clean 2026-02-17T11:21:30.022441+0000 29'100 63:165 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:36.021 INFO:tasks.workunit.client.0.trial148.stdout:1.6 5 0 0 0 0 3475 0 0 17 84 17 active+clean 2026-02-17T11:21:33.607421+0000 52'101 64:173 [0,1,2] 0 [0,1,2] 0 52'101 2026-02-17T11:21:33.607360+0000 52'101 2026-02-17T11:21:33.607360+0000 0 1 periodic scrub scheduled @ 2026-02-18T16:33:20.664521+0000 5 0 2026-02-17T11:21:36.021 INFO:tasks.workunit.client.0.trial148.stdout:1.5 6 0 0 0 0 4170 0 0 16 84 16 active+clean 2026-02-17T11:21:33.224931+0000 29'100 64:157 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T11:21:33.224875+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T15:55:12.512065+0000 6 0 2026-02-17T11:21:36.021 INFO:tasks.workunit.client.0.trial148.stdout:1.4 2 0 0 0 0 1390 0 0 16 84 16 active+clean 2026-02-17T11:21:31.283459+0000 29'100 63:178 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T11:21:31.283397+0000 0'0 2026-02-17T11:19:27.671920+0000 0 1 periodic scrub scheduled @ 2026-02-18T15:03:16.262393+0000 2 0 2026-02-17T11:21:36.021 INFO:tasks.workunit.client.0.trial148.stdout:1.3 4 0 0 0 0 2172 0 0 10 90 10 active+clean 2026-02-17T11:21:30.022192+0000 29'100 63:167 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:36.021 INFO:tasks.workunit.client.0.trial148.stdout:1.2 1 0 0 0 0 695 0 0 16 84 16 active+clean 2026-02-17T11:21:28.614700+0000 29'100 64:178 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-17T11:21:28.614627+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T11:50:47.213297+0000 1 0 2026-02-17T11:21:36.021 INFO:tasks.workunit.client.0.trial148.stdout:1.c 3 0 0 0 0 2085 0 0 14 86 14 active+clean 2026-02-17T11:21:30.261406+0000 29'100 63:179 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T11:21:30.261331+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T15:41:51.429455+0000 3 0 2026-02-17T11:21:36.022 INFO:tasks.workunit.client.0.trial148.stdout:1.1 2 0 0 0 0 1390 0 0 16 84 16 active+clean 2026-02-17T11:21:31.223572+0000 29'100 64:157 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T11:21:31.223498+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T19:45:01.703182+0000 2 0 2026-02-17T11:21:36.022 INFO:tasks.workunit.client.0.trial148.stdout:1.1c 2 0 0 0 0 1390 0 0 16 84 16 active+clean 2026-02-17T11:21:23.150122+0000 29'100 63:178 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T11:21:23.150044+0000 29'100 2026-02-17T11:21:23.150044+0000 0 0 periodic scrub scheduled @ 2026-02-18T22:19:30.234092+0000 2 0 2026-02-17T11:21:36.022 INFO:tasks.workunit.client.0.trial148.stdout:1.0 3 0 0 0 0 2085 0 0 10 90 10 active+clean 2026-02-17T11:21:20.124758+0000 29'100 63:179 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T11:21:20.124697+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T22:28:06.525764+0000 3 0 2026-02-17T11:21:36.022 INFO:tasks.workunit.client.0.trial148.stdout:1.d 3 0 0 0 0 2085 0 0 16 84 16 active+clean 2026-02-17T11:21:27.140128+0000 29'100 64:157 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T11:21:27.140050+0000 0'0 2026-02-17T11:19:27.671920+0000 0 1 periodic scrub scheduled @ 2026-02-18T13:04:48.798328+0000 3 0 2026-02-17T11:21:36.022 INFO:tasks.workunit.client.0.trial148.stdout:1.e 4 0 0 0 0 3052 0 0 17 84 17 active+clean 2026-02-17T11:21:29.565871+0000 45'101 64:179 [0,1,2] 0 [0,1,2] 0 45'101 2026-02-17T11:21:29.565810+0000 45'101 2026-02-17T11:21:29.565810+0000 0 0 periodic scrub scheduled @ 2026-02-18T22:04:11.528382+0000 4 0 2026-02-17T11:21:36.022 INFO:tasks.workunit.client.0.trial148.stdout:1.f 3 0 0 0 0 2172 0 0 16 84 16 active+clean 2026-02-17T11:21:30.022682+0000 29'100 63:165 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:36.022 INFO:tasks.workunit.client.0.trial148.stdout:1.10 3 0 0 0 0 2085 0 0 10 90 10 active+clean 2026-02-17T11:21:21.139627+0000 29'100 63:179 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T11:21:21.139572+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T21:50:54.353877+0000 3 0 2026-02-17T11:21:36.022 INFO:tasks.workunit.client.0.trial148.stdout:1.11 3 0 0 0 0 2085 0 0 16 84 16 active+clean 2026-02-17T11:21:28.188590+0000 29'100 64:157 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T11:21:28.188352+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T16:57:39.947104+0000 3 0 2026-02-17T11:21:36.023 INFO:tasks.workunit.client.0.trial148.stdout:1.12 1 0 0 0 0 695 0 0 16 84 16 active+clean 2026-02-17T11:21:32.617514+0000 29'100 64:178 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-17T11:21:32.617457+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T17:58:57.264456+0000 1 0 2026-02-17T11:21:36.023 INFO:tasks.workunit.client.0.trial148.stdout:1.13 3 0 0 0 0 2085 0 0 10 90 10 active+clean 2026-02-17T11:21:33.244523+0000 29'100 63:175 [1,2,0] 1 [1,2,0] 1 29'100 2026-02-17T11:21:33.244462+0000 29'100 2026-02-17T11:21:33.244462+0000 0 0 periodic scrub scheduled @ 2026-02-18T17:13:38.351232+0000 3 0 2026-02-17T11:21:36.023 INFO:tasks.workunit.client.0.trial148.stdout:1.14 3 0 0 0 0 2172 0 0 10 90 10 active+clean 2026-02-17T11:21:19.454377+0000 29'100 63:171 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:36.023 INFO:tasks.workunit.client.0.trial148.stdout:1.15 3 0 0 0 0 2085 0 0 16 84 16 active+clean 2026-02-17T11:21:26.135860+0000 29'100 64:157 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T11:21:26.135783+0000 29'100 2026-02-17T11:21:26.135783+0000 0 1 periodic scrub scheduled @ 2026-02-18T18:07:14.394796+0000 3 0 2026-02-17T11:21:36.023 INFO:tasks.workunit.client.0.trial148.stdout:1.16 3 0 0 0 0 2172 0 0 16 84 16 active+clean 2026-02-17T11:21:28.023956+0000 29'100 64:170 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:36.023 INFO:tasks.workunit.client.0.trial148.stdout:1.17 3 0 0 0 0 2172 0 0 16 84 16 active+clean 2026-02-17T11:21:30.022858+0000 29'100 63:165 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:36.023 INFO:tasks.workunit.client.0.trial148.stdout:1.18 3 0 0 0 0 2085 0 0 10 90 10 active+clean 2026-02-17T11:21:29.230575+0000 29'100 63:179 [1,0,2] 1 [1,0,2] 1 29'100 2026-02-17T11:21:29.230505+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T20:13:30.737621+0000 3 0 2026-02-17T11:21:36.023 INFO:tasks.workunit.client.0.trial148.stdout:1.19 2 0 0 0 0 1390 0 0 16 84 16 active+clean 2026-02-17T11:21:29.224439+0000 29'100 64:157 [2,0,1] 2 [2,0,1] 2 29'100 2026-02-17T11:21:29.224363+0000 29'100 2026-02-17T11:21:24.126413+0000 0 0 periodic scrub scheduled @ 2026-02-18T16:34:10.050776+0000 2 0 2026-02-17T11:21:36.023 INFO:tasks.workunit.client.0.trial148.stdout:1.1a 4 0 0 0 0 2780 0 0 16 84 16 active+clean 2026-02-17T11:21:31.589760+0000 29'100 64:178 [0,1,2] 0 [0,1,2] 0 29'100 2026-02-17T11:21:31.589690+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 periodic scrub scheduled @ 2026-02-18T22:29:03.918771+0000 4 0 2026-02-17T11:21:36.024 INFO:tasks.workunit.client.0.trial148.stdout:1.1b 3 0 0 0 0 2172 0 0 10 90 10 active+clean 2026-02-17T11:21:30.022617+0000 29'100 63:169 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-17T11:19:27.671920+0000 0'0 2026-02-17T11:19:27.671920+0000 0 0 queued for scrub 0 0 2026-02-17T11:21:36.024 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:21:36.024 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:21:36.024 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:21:36.029 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:819: TEST_divergent_3: expr 2 + 2 2026-02-17T11:21:36.030 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:819: TEST_divergent_3: seq 1 4 2026-02-17T11:21:36.031 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:819: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T11:21:36.031 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:821: TEST_divergent_3: rados -p test get existing_1 td/divergent-priors/existing 2026-02-17T11:21:36.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:819: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T11:21:36.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:821: TEST_divergent_3: rados -p test get existing_2 td/divergent-priors/existing 2026-02-17T11:21:36.078 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:819: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T11:21:36.078 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:821: TEST_divergent_3: rados -p test get existing_3 td/divergent-priors/existing 2026-02-17T11:21:36.104 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:819: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T11:21:36.104 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:821: TEST_divergent_3: rados -p test get existing_4 td/divergent-priors/existing 2026-02-17T11:21:36.133 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: seq 1 2 2026-02-17T11:21:36.134 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T11:21:36.134 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-17T11:21:36.154 INFO:tasks.workunit.client.0.trial148.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-17T11:21:36.156 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-17T11:21:36.156 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-17T11:21:36.181 INFO:tasks.workunit.client.0.trial148.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-17T11:21:36.183 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: rm -f td/divergent-priors/existing 2026-02-17T11:21:36.185 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-17T11:21:36.186 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T11:21:36.190 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42ed261640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 29'104 (29'1) modify 1:d858c035:::existing_1:head by client.4561.0:1 2026-02-17T11:19:41.826905+0000 0 ObjectCleanRegions clean_offsets: [(967, 18446744073709550648)], clean_omap: true, new_object: false 2026-02-17T11:21:36.191 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42ed261640 20 _merge_object_divergent_entries: keeping 29'104 (29'1) modify 1:d858c035:::existing_1:head by client.4561.0:1 2026-02-17T11:19:41.826905+0000 0 ObjectCleanRegions clean_offsets: [(967, 18446744073709550648)], clean_omap: true, new_object: false 2026-02-17T11:21:36.191 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42ed261640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T11:21:36.191 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42ed261640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 29'1 first_divergent_update: 29'104 last_divergent_update: 29'104 2026-02-17T11:21:36.191 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42ed261640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-17T11:21:36.191 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42ed261640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-17T11:21:36.191 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42ed261640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 29'106 2026-02-17T11:21:36.192 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42ed261640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 29'104 (29'1) modify 1:d858c035:::existing_1:head by client.4561.0:1 2026-02-17T11:19:41.826905+0000 0 ObjectCleanRegions clean_offsets: [(967, 18446744073709550648)], clean_omap: true, new_object: false 2026-02-17T11:21:36.192 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42ed261640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-17T11:21:36.192 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42ed261640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 29'1 <= info.log_tail 29'90 2026-02-17T11:21:36.192 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42ed261640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 29'101 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4554.0:1 2026-02-17T11:19:41.823588+0000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false 2026-02-17T11:21:36.192 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42ed261640 20 _merge_object_divergent_entries: keeping 29'101 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4554.0:1 2026-02-17T11:19:41.823588+0000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false 2026-02-17T11:21:36.192 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42ed261640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T11:21:36.192 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42ed261640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 29'101 last_divergent_update: 29'101 2026-02-17T11:21:36.193 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42ed261640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-17T11:21:36.193 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42ed261640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-17T11:21:36.193 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42f226b640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4564.0:1 2026-02-17T11:19:41.830160+0000 0 ObjectCleanRegions clean_offsets: [(695, 18446744073709550920)], clean_omap: false, new_object: false 2026-02-17T11:21:36.193 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42f226b640 20 _merge_object_divergent_entries: keeping 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4564.0:1 2026-02-17T11:19:41.830160+0000 0 ObjectCleanRegions clean_offsets: [(695, 18446744073709550920)], clean_omap: false, new_object: false 2026-02-17T11:21:36.193 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42f226b640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-17T11:21:36.193 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42f226b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 29'3 first_divergent_update: 29'105 last_divergent_update: 29'105 2026-02-17T11:21:36.194 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42f226b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-17T11:21:36.194 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42f226b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-17T11:21:36.194 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42f226b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 29'106 2026-02-17T11:21:36.194 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42f226b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 29'105 (29'3) delete 1:8881e6d8:::existing_3:head by client.4564.0:1 2026-02-17T11:19:41.830160+0000 0 ObjectCleanRegions clean_offsets: [(695, 18446744073709550920)], clean_omap: false, new_object: false 2026-02-17T11:21:36.194 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42f226b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-17T11:21:36.194 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.855+0000 7f42f226b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 29'3 <= info.log_tail 29'84 2026-02-17T11:21:36.194 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42ee263640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 29'103 (29'2) modify 1:97db2a0f:::existing_2:head by client.4560.0:1 2026-02-17T11:19:41.826133+0000 0 ObjectCleanRegions clean_offsets: [(967, 18446744073709550648)], clean_omap: true, new_object: false 2026-02-17T11:21:36.195 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42ee263640 20 _merge_object_divergent_entries: keeping 29'103 (29'2) modify 1:97db2a0f:::existing_2:head by client.4560.0:1 2026-02-17T11:19:41.826133+0000 0 ObjectCleanRegions clean_offsets: [(967, 18446744073709550648)], clean_omap: true, new_object: false 2026-02-17T11:21:36.195 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42ee263640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T11:21:36.195 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42ee263640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 29'2 first_divergent_update: 29'103 last_divergent_update: 29'103 2026-02-17T11:21:36.195 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42ee263640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-17T11:21:36.195 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42ee263640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-17T11:21:36.195 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42ee263640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 29'106 2026-02-17T11:21:36.195 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42ee263640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 29'103 (29'2) modify 1:97db2a0f:::existing_2:head by client.4560.0:1 2026-02-17T11:19:41.826133+0000 0 ObjectCleanRegions clean_offsets: [(967, 18446744073709550648)], clean_omap: true, new_object: false 2026-02-17T11:21:36.201 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42ee263640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-17T11:21:36.201 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42ee263640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 29'2 <= info.log_tail 29'89 2026-02-17T11:21:36.201 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42eba5e640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 29'106 (29'4) delete 1:70b3bf12:::existing_4:head by client.4567.0:1 2026-02-17T11:19:41.832925+0000 0 ObjectCleanRegions clean_offsets: [(695, 18446744073709550920)], clean_omap: false, new_object: false 2026-02-17T11:21:36.201 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42eba5e640 20 _merge_object_divergent_entries: keeping 29'106 (29'4) delete 1:70b3bf12:::existing_4:head by client.4567.0:1 2026-02-17T11:19:41.832925+0000 0 ObjectCleanRegions clean_offsets: [(695, 18446744073709550920)], clean_omap: false, new_object: false 2026-02-17T11:21:36.202 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42eba5e640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T11:21:36.202 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42eba5e640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 29'4 first_divergent_update: 29'106 last_divergent_update: 29'106 2026-02-17T11:21:36.202 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42eba5e640 10 _merge_object_divergent_entries: more recent entry found: 45'101 (29'4) modify 1:70b3bf12:::existing_4:head by client.4688.0:1 2026-02-17T11:20:33.921629+0000 0 ObjectCleanRegions clean_offsets: [(967, 18446744073709550648)], clean_omap: true, new_object: false, already merged 2026-02-17T11:21:36.202 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42eba5e640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 29'102 (0'0) modify 1:75ac5091:::newobject_2:head by client.4556.0:1 2026-02-17T11:19:41.824609+0000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false 2026-02-17T11:21:36.202 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42eba5e640 20 _merge_object_divergent_entries: keeping 29'102 (0'0) modify 1:75ac5091:::newobject_2:head by client.4556.0:1 2026-02-17T11:19:41.824609+0000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false 2026-02-17T11:21:36.202 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42eba5e640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T11:21:36.202 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42eba5e640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 29'102 last_divergent_update: 29'102 2026-02-17T11:21:36.203 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42eba5e640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-17T11:21:36.203 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:21:10.859+0000 7f42eba5e640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-17T11:21:36.204 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:831: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-17T11:21:36.204 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:831: TEST_divergent_3: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T11:21:36.207 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:837: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-17T11:21:36.208 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:837: TEST_divergent_3: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T11:21:36.211 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:842: TEST_divergent_3: echo success 2026-02-17T11:21:36.212 INFO:tasks.workunit.client.0.trial148.stdout:success 2026-02-17T11:21:36.213 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:844: TEST_divergent_3: rm td/divergent-priors/td/divergent-priors/exp.19803.out 2026-02-17T11:21:36.213 INFO:tasks.workunit.client.0.trial148.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.19803.out': No such file or directory 2026-02-17T11:21:36.213 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:846: TEST_divergent_3: delete_pool test 2026-02-17T11:21:36.213 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test 2026-02-17T11:21:36.213 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-17T11:21:36.480 INFO:tasks.workunit.client.0.trial148.stderr:pool 'test' does not exist 2026-02-17T11:21:36.490 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:847: TEST_divergent_3: kill_daemons td/divergent-priors 2026-02-17T11:21:36.492 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:21:36.492 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:21:36.492 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:21:36.492 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:21:36.492 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:21:44.808 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:21:44.808 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-17T11:21:44.808 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/divergent-priors 2026-02-17T11:21:44.808 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T11:21:44.809 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T11:21:44.809 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:21:44.809 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:21:44.810 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:21:44.810 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:21:44.810 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:21:44.816 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:21:44.816 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:21:44.817 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:21:44.818 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:21:44.819 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:21:44.819 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:21:44.820 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:21:44.821 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:21:44.821 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:21:44.821 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:21:44.822 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:21:44.822 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:21:44.824 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T11:21:44.824 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/divergent-priors 2026-02-17T11:21:44.853 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:21:44.853 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:21:44.853 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:21:44.853 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.19803 2026-02-17T11:21:44.855 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T11:21:44.855 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T11:21:44.856 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-17T11:21:44.856 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-17T11:21:44.856 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/divergent-priors 2026-02-17T11:21:44.856 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/divergent-priors 2026-02-17T11:21:44.856 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/divergent-priors 2026-02-17T11:21:44.856 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T11:21:44.856 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T11:21:44.856 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:21:44.856 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:21:44.856 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:21:44.856 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:21:44.857 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:21:44.857 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:21:44.858 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:21:44.859 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:21:44.859 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:21:44.860 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:21:44.860 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:21:44.861 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:21:44.861 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:21:44.862 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:21:44.862 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:21:44.862 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:21:44.863 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:21:44.864 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T11:21:44.865 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/divergent-priors 2026-02-17T11:21:44.866 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:21:44.866 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:21:44.866 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:21:44.866 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.19803 2026-02-17T11:21:44.867 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T11:21:44.867 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T11:21:44.867 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/divergent-priors 2026-02-17T11:21:44.869 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T11:21:44.869 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:21:44.869 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:21:44.869 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.19803 2026-02-17T11:21:44.870 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T11:21:44.871 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 4096 -le 1024 ']' 2026-02-17T11:21:44.871 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T11:21:44.872 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-17T11:21:44.872 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_ec td/divergent-priors 2026-02-17T11:21:44.872 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:228: TEST_divergent_ec: local dir=td/divergent-priors 2026-02-17T11:21:44.872 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: local dummyfile=/etc/fstab 2026-02-17T11:21:44.872 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:232: TEST_divergent_ec: local dummyfile2=/etc/resolv.conf 2026-02-17T11:21:44.872 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: local num_osds=3 2026-02-17T11:21:44.872 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:235: TEST_divergent_ec: expr 3 - 1 2026-02-17T11:21:44.873 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:235: TEST_divergent_ec: seq 0 2 2026-02-17T11:21:44.874 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:235: TEST_divergent_ec: local 'osds=0 2026-02-17T11:21:44.874 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:21:44.874 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:21:44.875 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:236: TEST_divergent_ec: run_mon td/divergent-priors a 2026-02-17T11:21:44.875 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/divergent-priors 2026-02-17T11:21:44.875 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T11:21:44.875 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T11:21:44.875 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T11:21:44.875 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/divergent-priors/a 2026-02-17T11:21:44.875 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-17T11:21:44.898 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T11:21:44.898 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:21:44.899 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:21:44.899 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:21:44.899 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:21:44.899 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:21:44.899 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:21:44.899 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T11:21:44.928 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T11:21:44.929 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T11:21:44.929 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T11:21:44.930 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T11:21:44.930 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T11:21:44.931 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T11:21:44.931 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T11:21:44.931 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T11:21:44.931 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T11:21:44.931 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:21:44.931 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:21:44.931 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:21:44.931 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-mon.a.asok 2026-02-17T11:21:44.932 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T11:21:44.932 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.19803/ceph-mon.a.asok config get fsid 2026-02-17T11:21:44.987 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T11:21:44.987 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T11:21:44.988 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T11:21:44.988 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T11:21:44.988 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T11:21:44.989 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T11:21:44.989 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T11:21:44.989 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T11:21:44.989 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:21:44.989 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:21:44.989 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:21:44.990 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-mon.a.asok 2026-02-17T11:21:44.990 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T11:21:44.990 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.19803/ceph-mon.a.asok config get mon_host 2026-02-17T11:21:45.043 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: run_mgr td/divergent-priors x 2026-02-17T11:21:45.043 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/divergent-priors 2026-02-17T11:21:45.043 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T11:21:45.043 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T11:21:45.044 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T11:21:45.044 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/divergent-priors/x 2026-02-17T11:21:45.044 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T11:21:45.161 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T11:21:45.161 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:21:45.161 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:21:45.161 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:21:45.161 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:21:45.161 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:21:45.162 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:21:45.162 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T11:21:45.163 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T11:21:45.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:238: TEST_divergent_ec: for i in $osds 2026-02-17T11:21:45.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:240: TEST_divergent_ec: run_osd td/divergent-priors 0 2026-02-17T11:21:45.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/divergent-priors 2026-02-17T11:21:45.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:21:45.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T11:21:45.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:21:45.186 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/divergent-priors/0 2026-02-17T11:21:45.186 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:21:45.186 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:21:45.186 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:21:45.186 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:21:45.186 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T11:21:45.186 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T11:21:45.186 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:21:45.186 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:21:45.186 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:21:45.186 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:21:45.186 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:21:45.187 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:21:45.187 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:21:45.187 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:21:45.187 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:21:45.187 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:21:45.187 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:21:45.187 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:21:45.187 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:21:45.187 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:21:45.187 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:21:45.187 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:21:45.187 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:21:45.187 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:21:45.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:21:45.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:21:45.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:21:45.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:21:45.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/divergent-priors/0 2026-02-17T11:21:45.188 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:21:45.189 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=02e759ad-aae7-4421-aea5-d8a4d4e52bb4 2026-02-17T11:21:45.189 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 02e759ad-aae7-4421-aea5-d8a4d4e52bb4' 2026-02-17T11:21:45.189 INFO:tasks.workunit.client.0.trial148.stdout:add osd0 02e759ad-aae7-4421-aea5-d8a4d4e52bb4 2026-02-17T11:21:45.189 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:21:45.200 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBJT5RpLZezCxAAp/AAblurMNTLKSFrdkCHsw== 2026-02-17T11:21:45.200 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBJT5RpLZezCxAAp/AAblurMNTLKSFrdkCHsw=="}' 2026-02-17T11:21:45.200 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 02e759ad-aae7-4421-aea5-d8a4d4e52bb4 -i td/divergent-priors/0/new.json 2026-02-17T11:21:45.314 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:21:45.322 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/divergent-priors/0/new.json 2026-02-17T11:21:45.324 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBJT5RpLZezCxAAp/AAblurMNTLKSFrdkCHsw== --osd-uuid 02e759ad-aae7-4421-aea5-d8a4d4e52bb4 2026-02-17T11:21:45.341 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:45.335+0000 7f384fcf68c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:21:45.343 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:45.335+0000 7f384fcf68c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:21:45.343 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:45.335+0000 7f384fcf68c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:21:45.344 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:45.335+0000 7f384fcf68c0 -1 bdev(0x5568634c3c00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-17T11:21:45.344 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:45.335+0000 7f384fcf68c0 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-17T11:21:47.950 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-17T11:21:47.950 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:21:47.951 INFO:tasks.workunit.client.0.trial148.stdout:adding osd0 key to auth repository 2026-02-17T11:21:47.952 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T11:21:47.952 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:21:48.223 INFO:tasks.workunit.client.0.trial148.stdout:start osd.0 2026-02-17T11:21:48.224 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T11:21:48.224 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:21:48.224 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:21:48.224 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:21:48.224 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:21:48.251 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:48.243+0000 7fe412fa28c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:21:48.253 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:48.243+0000 7fe412fa28c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:21:48.254 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:48.247+0000 7fe412fa28c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:21:48.432 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T11:21:48.432 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:21:48.432 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T11:21:48.432 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:21:48.432 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:21:48.432 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:21:48.433 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:21:48.433 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:21:48.433 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:21:48.434 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:21:48.634 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:21:49.635 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:21:49.635 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:21:49.636 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:21:49.636 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:21:49.636 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:21:49.636 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:21:49.787 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:49.779+0000 7fe412fa28c0 -1 Falling back to public interface 2026-02-17T11:21:49.837 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:21:50.838 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:21:50.839 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:21:50.839 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:21:50.840 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:21:50.840 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:21:50.840 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:21:51.048 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:21:52.050 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:21:52.050 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:21:52.050 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:21:52.051 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:21:52.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:21:52.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:21:52.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:21:52.800 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:52.791+0000 7fe412fa28c0 -1 osd.0 0 log_to_monitors true 2026-02-17T11:21:53.252 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:21:53.253 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:21:53.253 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:21:53.253 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:21:53.254 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:21:53.254 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:21:53.454 INFO:tasks.workunit.client.0.trial148.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3953660153,v1:127.0.0.1:6803/3953660153] [v2:127.0.0.1:6804/3953660153,v1:127.0.0.1:6805/3953660153] exists,up 02e759ad-aae7-4421-aea5-d8a4d4e52bb4 2026-02-17T11:21:53.458 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:21:53.458 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:21:53.458 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:21:53.458 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:238: TEST_divergent_ec: for i in $osds 2026-02-17T11:21:53.458 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:240: TEST_divergent_ec: run_osd td/divergent-priors 1 2026-02-17T11:21:53.458 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/divergent-priors 2026-02-17T11:21:53.458 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:21:53.458 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T11:21:53.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:21:53.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/divergent-priors/1 2026-02-17T11:21:53.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:21:53.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:21:53.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:21:53.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:21:53.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T11:21:53.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T11:21:53.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:21:53.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:21:53.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:21:53.460 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:21:53.460 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:21:53.460 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:21:53.460 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:21:53.460 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:21:53.460 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:21:53.460 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:21:53.460 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:21:53.460 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:21:53.460 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:21:53.460 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:21:53.460 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:21:53.461 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:21:53.461 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:21:53.461 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:21:53.461 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:21:53.461 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:21:53.461 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:21:53.461 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:21:53.461 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/divergent-priors/1 2026-02-17T11:21:53.462 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:21:53.462 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=1b0c045e-9cdd-417f-946e-6a48f886c5a3 2026-02-17T11:21:53.462 INFO:tasks.workunit.client.0.trial148.stdout:add osd1 1b0c045e-9cdd-417f-946e-6a48f886c5a3 2026-02-17T11:21:53.463 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 1b0c045e-9cdd-417f-946e-6a48f886c5a3' 2026-02-17T11:21:53.463 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:21:53.474 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBRT5Rp+tINHBAAQ1swzGqqEI6qL9TUhjsFGw== 2026-02-17T11:21:53.475 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBRT5Rp+tINHBAAQ1swzGqqEI6qL9TUhjsFGw=="}' 2026-02-17T11:21:53.475 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 1b0c045e-9cdd-417f-946e-6a48f886c5a3 -i td/divergent-priors/1/new.json 2026-02-17T11:21:53.687 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:21:53.698 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/divergent-priors/1/new.json 2026-02-17T11:21:53.699 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBRT5Rp+tINHBAAQ1swzGqqEI6qL9TUhjsFGw== --osd-uuid 1b0c045e-9cdd-417f-946e-6a48f886c5a3 2026-02-17T11:21:53.726 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:53.719+0000 7feb003028c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:21:53.727 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:53.719+0000 7feb003028c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:21:53.728 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:53.719+0000 7feb003028c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:21:53.729 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:53.719+0000 7feb003028c0 -1 bdev(0x56139d7a7c00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-17T11:21:53.729 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:53.719+0000 7feb003028c0 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-17T11:21:56.002 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-17T11:21:56.003 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:21:56.003 INFO:tasks.workunit.client.0.trial148.stdout:adding osd1 key to auth repository 2026-02-17T11:21:56.004 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T11:21:56.004 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:21:56.271 INFO:tasks.workunit.client.0.trial148.stdout:start osd.1 2026-02-17T11:21:56.272 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T11:21:56.272 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:21:56.272 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:21:56.272 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:21:56.272 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:21:56.298 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:56.291+0000 7fe1c4f598c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:21:56.300 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:56.291+0000 7fe1c4f598c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:21:56.301 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:56.291+0000 7fe1c4f598c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:21:56.479 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T11:21:56.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:21:56.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T11:21:56.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:21:56.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:21:56.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:21:56.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:21:56.480 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:21:56.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:21:56.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:21:56.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:21:57.685 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:21:57.686 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:21:57.686 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:21:57.686 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:21:57.687 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:21:57.687 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:21:57.807 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:21:57.799+0000 7fe1c4f598c0 -1 Falling back to public interface 2026-02-17T11:21:57.887 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:21:58.888 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:21:58.889 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:21:58.889 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:21:58.890 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:21:58.890 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:21:58.890 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:21:59.087 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:22:00.089 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:22:00.089 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:22:00.089 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:22:00.090 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:22:00.090 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:22:00.090 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:22:00.285 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:22:01.048 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:01.039+0000 7fe1c4f598c0 -1 osd.1 0 log_to_monitors true 2026-02-17T11:22:01.286 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:22:01.287 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:22:01.287 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:22:01.288 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:22:01.288 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:22:01.288 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:22:01.488 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:22:02.490 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:22:02.490 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:22:02.490 INFO:tasks.workunit.client.0.trial148.stdout:5 2026-02-17T11:22:02.491 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T11:22:02.491 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:22:02.491 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:22:02.689 INFO:tasks.workunit.client.0.trial148.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/585555032,v1:127.0.0.1:6811/585555032] [v2:127.0.0.1:6812/585555032,v1:127.0.0.1:6813/585555032] exists,up 1b0c045e-9cdd-417f-946e-6a48f886c5a3 2026-02-17T11:22:02.692 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:22:02.692 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:22:02.693 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:22:02.693 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:238: TEST_divergent_ec: for i in $osds 2026-02-17T11:22:02.693 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:240: TEST_divergent_ec: run_osd td/divergent-priors 2 2026-02-17T11:22:02.693 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/divergent-priors 2026-02-17T11:22:02.693 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:22:02.693 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T11:22:02.693 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:22:02.693 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/divergent-priors/2 2026-02-17T11:22:02.693 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:22:02.693 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:22:02.694 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:22:02.694 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:22:02.694 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T11:22:02.694 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T11:22:02.694 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:22:02.694 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:22:02.694 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:22:02.694 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:22:02.694 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:22:02.694 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:22:02.694 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:22:02.694 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:22:02.694 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:22:02.695 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:22:02.695 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:22:02.695 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:22:02.695 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:22:02.695 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:22:02.695 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:22:02.695 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:22:02.695 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:22:02.695 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:22:02.695 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:22:02.695 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:22:02.695 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:22:02.696 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:22:02.696 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/divergent-priors/2 2026-02-17T11:22:02.696 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:22:02.696 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=fff8f662-3096-4544-a866-04d1e788f94c 2026-02-17T11:22:02.696 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 fff8f662-3096-4544-a866-04d1e788f94c' 2026-02-17T11:22:02.697 INFO:tasks.workunit.client.0.trial148.stdout:add osd2 fff8f662-3096-4544-a866-04d1e788f94c 2026-02-17T11:22:02.697 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:22:02.709 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBaT5Rpba8AKhAAVSLS0Hi3GT4mTUo+4Xo52Q== 2026-02-17T11:22:02.709 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBaT5Rpba8AKhAAVSLS0Hi3GT4mTUo+4Xo52Q=="}' 2026-02-17T11:22:02.709 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new fff8f662-3096-4544-a866-04d1e788f94c -i td/divergent-priors/2/new.json 2026-02-17T11:22:02.917 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:22:02.926 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/divergent-priors/2/new.json 2026-02-17T11:22:02.927 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBaT5Rpba8AKhAAVSLS0Hi3GT4mTUo+4Xo52Q== --osd-uuid fff8f662-3096-4544-a866-04d1e788f94c 2026-02-17T11:22:02.945 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:02.938+0000 7f6babdce8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:22:02.947 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:02.938+0000 7f6babdce8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:22:02.948 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:02.938+0000 7f6babdce8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:22:02.949 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:02.938+0000 7f6babdce8c0 -1 bdev(0x5606ec85bc00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-17T11:22:02.949 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:02.938+0000 7f6babdce8c0 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-17T11:22:05.498 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-17T11:22:05.499 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:22:05.499 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T11:22:05.500 INFO:tasks.workunit.client.0.trial148.stdout:adding osd2 key to auth repository 2026-02-17T11:22:05.500 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:22:05.774 INFO:tasks.workunit.client.0.trial148.stdout:start osd.2 2026-02-17T11:22:05.775 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T11:22:05.775 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:22:05.775 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:22:05.775 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:22:05.775 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:22:05.801 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:05.790+0000 7f141494d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:22:05.803 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:05.794+0000 7f141494d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:22:05.804 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:05.794+0000 7f141494d8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:22:05.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T11:22:05.983 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:22:05.983 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T11:22:05.983 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:22:05.983 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:22:05.983 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:22:05.983 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:22:05.984 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:22:05.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:22:05.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:22:06.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:22:07.189 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:22:07.189 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:22:07.189 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:22:07.190 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:22:07.190 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:22:07.190 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:22:07.387 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:22:07.531 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:07.522+0000 7f141494d8c0 -1 Falling back to public interface 2026-02-17T11:22:08.388 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:22:08.388 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:22:08.388 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:22:08.389 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:22:08.389 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:22:08.389 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:22:08.591 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:22:09.593 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:22:09.593 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:22:09.593 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:22:09.594 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:22:09.594 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:22:09.594 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:22:09.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:22:10.542 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:10.534+0000 7f141494d8c0 -1 osd.2 0 log_to_monitors true 2026-02-17T11:22:10.792 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:22:10.792 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:22:10.793 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:22:10.793 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:22:10.794 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:22:10.794 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:22:10.999 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:22:12.001 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:22:12.001 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:22:12.001 INFO:tasks.workunit.client.0.trial148.stdout:5 2026-02-17T11:22:12.002 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T11:22:12.002 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:22:12.002 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:22:12.200 INFO:tasks.workunit.client.0.trial148.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2864519066,v1:127.0.0.1:6819/2864519066] [v2:127.0.0.1:6820/2864519066,v1:127.0.0.1:6821/2864519066] exists,up fff8f662-3096-4544-a866-04d1e788f94c 2026-02-17T11:22:12.201 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:22:12.201 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:22:12.201 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:22:12.201 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:243: TEST_divergent_ec: ceph osd set noout 2026-02-17T11:22:12.498 INFO:tasks.workunit.client.0.trial148.stderr:noout is set 2026-02-17T11:22:12.508 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:244: TEST_divergent_ec: ceph osd set noin 2026-02-17T11:22:12.805 INFO:tasks.workunit.client.0.trial148.stderr:noin is set 2026-02-17T11:22:12.814 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:245: TEST_divergent_ec: ceph osd set nodown 2026-02-17T11:22:13.109 INFO:tasks.workunit.client.0.trial148.stderr:nodown is set 2026-02-17T11:22:13.119 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:246: TEST_divergent_ec: create_ec_pool test true k=2 m=1 2026-02-17T11:22:13.119 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2498: create_ec_pool: local pool_name=test 2026-02-17T11:22:13.119 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: create_ec_pool: shift 2026-02-17T11:22:13.119 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: create_ec_pool: local allow_overwrites=true 2026-02-17T11:22:13.119 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: create_ec_pool: shift 2026-02-17T11:22:13.119 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-17T11:22:13.374 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2505: create_ec_pool: create_pool test 1 1 erasure myprofile 2026-02-17T11:22:13.374 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create test 1 1 erasure myprofile 2026-02-17T11:22:13.766 INFO:tasks.workunit.client.0.trial148.stderr:pool 'test' already exists 2026-02-17T11:22:13.776 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T11:22:14.777 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2507: create_ec_pool: '[' true = true ']' 2026-02-17T11:22:14.777 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2508: create_ec_pool: ceph osd pool set test allow_ec_overwrites true 2026-02-17T11:22:15.076 INFO:tasks.workunit.client.0.trial148.stderr:set pool 1 allow_ec_overwrites to true 2026-02-17T11:22:15.088 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2511: create_ec_pool: wait_for_clean 2026-02-17T11:22:15.088 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T11:22:15.088 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T11:22:15.088 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T11:22:15.089 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T11:22:15.090 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T11:22:15.090 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T11:22:15.090 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T11:22:15.090 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T11:22:15.090 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T11:22:15.205 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T11:22:15.206 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T11:22:15.206 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T11:22:15.206 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T11:22:15.206 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:22:15.206 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:22:15.398 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:22:15.398 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:22:15.398 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:22:15.399 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:22:15.399 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:22:15.399 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:22:15.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836487 2026-02-17T11:22:15.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836487 2026-02-17T11:22:15.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487' 2026-02-17T11:22:15.481 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:22:15.481 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:22:15.559 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=42949672965 2026-02-17T11:22:15.559 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 42949672965 2026-02-17T11:22:15.559 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487 1-42949672965' 2026-02-17T11:22:15.559 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:22:15.559 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:22:15.643 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=64424509443 2026-02-17T11:22:15.643 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 64424509443 2026-02-17T11:22:15.643 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836487 1-42949672965 2-64424509443' 2026-02-17T11:22:15.643 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:22:15.644 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836487 2026-02-17T11:22:15.644 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:22:15.645 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:22:15.645 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836487 2026-02-17T11:22:15.645 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:22:15.647 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836487 2026-02-17T11:22:15.647 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 21474836487 2026-02-17T11:22:15.648 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-17T11:22:15.648 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:22:15.853 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-17T11:22:15.853 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:22:16.854 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:22:16.855 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:22:17.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-17T11:22:17.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:22:18.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T11:22:18.053 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:22:18.265 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-17T11:22:18.265 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:22:18.265 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-42949672965 2026-02-17T11:22:18.266 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:22:18.267 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T11:22:18.268 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-42949672965 2026-02-17T11:22:18.268 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:22:18.269 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=42949672965 2026-02-17T11:22:18.269 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 42949672965' 2026-02-17T11:22:18.270 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.1 seq 42949672965 2026-02-17T11:22:18.270 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T11:22:18.469 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 42949672966 -lt 42949672965 2026-02-17T11:22:18.469 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:22:18.470 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-64424509443 2026-02-17T11:22:18.470 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:22:18.471 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:22:18.472 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-64424509443 2026-02-17T11:22:18.472 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:22:18.474 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=64424509443 2026-02-17T11:22:18.474 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 64424509443 2026-02-17T11:22:18.475 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 64424509443' 2026-02-17T11:22:18.475 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:22:18.690 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 64424509444 -lt 64424509443 2026-02-17T11:22:18.691 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T11:22:18.692 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:22:18.692 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:22:18.964 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 == 0 2026-02-17T11:22:18.965 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:22:18.965 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:22:18.965 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:22:18.965 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:22:18.965 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:22:18.965 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:22:18.965 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:22:19.169 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=1 2026-02-17T11:22:19.170 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:22:19.170 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:22:19.170 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:22:19.440 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 1 = 1 2026-02-17T11:22:19.440 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T11:22:19.440 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T11:22:19.440 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2512: create_ec_pool: return 0 2026-02-17T11:22:19.440 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:248: TEST_divergent_ec: flush_pg_stats 2026-02-17T11:22:19.441 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:22:19.441 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:22:19.642 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:22:19.643 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:22:19.643 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:22:19.643 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:22:19.643 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:22:19.643 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:22:19.724 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836490 2026-02-17T11:22:19.724 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836490 2026-02-17T11:22:19.724 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836490' 2026-02-17T11:22:19.724 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:22:19.725 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:22:19.803 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=42949672968 2026-02-17T11:22:19.803 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 42949672968 2026-02-17T11:22:19.804 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836490 1-42949672968' 2026-02-17T11:22:19.804 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:22:19.804 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:22:19.884 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=64424509446 2026-02-17T11:22:19.884 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 64424509446 2026-02-17T11:22:19.884 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836490 1-42949672968 2-64424509446' 2026-02-17T11:22:19.884 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:22:19.885 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836490 2026-02-17T11:22:19.885 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:22:19.885 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:22:19.886 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836490 2026-02-17T11:22:19.887 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:22:19.888 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836490 2026-02-17T11:22:19.888 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 21474836490 2026-02-17T11:22:19.888 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-17T11:22:19.889 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:22:20.092 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-17T11:22:20.093 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:22:21.094 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:22:21.094 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:22:21.308 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-17T11:22:21.308 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:22:22.310 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T11:22:22.310 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:22:22.508 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-17T11:22:22.508 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:22:22.509 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-42949672968 2026-02-17T11:22:22.509 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:22:22.510 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T11:22:22.511 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-42949672968 2026-02-17T11:22:22.511 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:22:22.512 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=42949672968 2026-02-17T11:22:22.512 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 42949672968' 2026-02-17T11:22:22.513 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.1 seq 42949672968 2026-02-17T11:22:22.513 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T11:22:22.729 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 42949672968 -lt 42949672968 2026-02-17T11:22:22.730 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:22:22.730 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-64424509446 2026-02-17T11:22:22.730 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:22:22.731 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:22:22.732 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-64424509446 2026-02-17T11:22:22.732 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:22:22.734 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=64424509446 2026-02-17T11:22:22.734 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 64424509446' 2026-02-17T11:22:22.734 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 64424509446 2026-02-17T11:22:22.734 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:22:22.931 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 64424509446 -lt 64424509446 2026-02-17T11:22:22.931 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:249: TEST_divergent_ec: wait_for_clean 2026-02-17T11:22:22.931 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T11:22:22.931 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T11:22:22.931 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T11:22:22.931 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T11:22:22.932 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T11:22:22.933 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T11:22:22.933 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T11:22:22.933 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T11:22:22.933 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T11:22:23.035 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T11:22:23.035 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T11:22:23.035 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T11:22:23.035 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T11:22:23.035 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:22:23.035 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:22:23.243 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:22:23.243 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:22:23.243 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:22:23.243 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:22:23.243 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:22:23.243 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:22:23.325 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836492 2026-02-17T11:22:23.325 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836492 2026-02-17T11:22:23.325 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836492' 2026-02-17T11:22:23.326 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:22:23.326 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:22:23.407 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=42949672971 2026-02-17T11:22:23.407 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 42949672971 2026-02-17T11:22:23.407 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836492 1-42949672971' 2026-02-17T11:22:23.407 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:22:23.407 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:22:23.483 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=64424509449 2026-02-17T11:22:23.483 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 64424509449 2026-02-17T11:22:23.483 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836492 1-42949672971 2-64424509449' 2026-02-17T11:22:23.484 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:22:23.484 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836492 2026-02-17T11:22:23.484 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:22:23.485 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:22:23.486 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836492 2026-02-17T11:22:23.486 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:22:23.487 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836492 2026-02-17T11:22:23.488 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 21474836492 2026-02-17T11:22:23.488 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-17T11:22:23.488 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:22:23.693 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836492 -lt 21474836492 2026-02-17T11:22:23.693 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:22:23.694 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-42949672971 2026-02-17T11:22:23.694 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:22:23.695 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T11:22:23.696 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-42949672971 2026-02-17T11:22:23.696 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:22:23.697 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=42949672971 2026-02-17T11:22:23.698 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.1 seq 42949672971 2026-02-17T11:22:23.698 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 42949672971' 2026-02-17T11:22:23.698 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T11:22:23.906 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 42949672971 -lt 42949672971 2026-02-17T11:22:23.906 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:22:23.907 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-64424509449 2026-02-17T11:22:23.907 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:22:23.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:22:23.909 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-64424509449 2026-02-17T11:22:23.909 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:22:23.911 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=64424509449 2026-02-17T11:22:23.911 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 64424509449' 2026-02-17T11:22:23.911 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 64424509449 2026-02-17T11:22:23.911 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:22:24.120 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 64424509447 -lt 64424509449 2026-02-17T11:22:24.120 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:22:25.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:22:25.122 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:22:25.321 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 64424509447 -lt 64424509449 2026-02-17T11:22:25.321 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:22:26.322 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T11:22:26.323 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:22:26.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 64424509449 -lt 64424509449 2026-02-17T11:22:26.537 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T11:22:26.537 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:22:26.537 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:22:26.811 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 == 0 2026-02-17T11:22:26.811 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:22:26.812 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:22:26.813 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:22:26.813 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:22:26.813 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:22:26.813 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:22:26.813 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:22:27.013 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=1 2026-02-17T11:22:27.014 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:22:27.014 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:22:27.015 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:22:27.287 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 1 = 1 2026-02-17T11:22:27.288 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T11:22:27.288 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T11:22:27.288 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:252: TEST_divergent_ec: jq '.pg_stats[0].up_primary' 2026-02-17T11:22:27.288 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:252: TEST_divergent_ec: ceph pg dump pgs --format=json 2026-02-17T11:22:27.482 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:22:27.492 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:252: TEST_divergent_ec: local divergent=1 2026-02-17T11:22:27.492 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:253: TEST_divergent_ec: echo 'primary and soon to be divergent is 1' 2026-02-17T11:22:27.492 INFO:tasks.workunit.client.0.trial148.stdout:primary and soon to be divergent is 1 2026-02-17T11:22:27.493 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:254: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T11:22:27.678 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:22:27.678 INFO:tasks.workunit.client.0.trial148.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-17T11:22:13.942922+0000 0'0 28:17 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:22:13.713825+0000 0'0 2026-02-17T11:22:13.713825+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:37:30.258832+0000 0 0 2026-02-17T11:22:27.678 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:22:27.678 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:22:27.679 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:22:27.688 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: local non_divergent= 2026-02-17T11:22:27.688 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:256: TEST_divergent_ec: for i in $osds 2026-02-17T11:22:27.688 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:258: TEST_divergent_ec: '[' 0 = 1 ']' 2026-02-17T11:22:27.688 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:261: TEST_divergent_ec: non_divergent=' 0' 2026-02-17T11:22:27.688 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:256: TEST_divergent_ec: for i in $osds 2026-02-17T11:22:27.688 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:258: TEST_divergent_ec: '[' 1 = 1 ']' 2026-02-17T11:22:27.688 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:259: TEST_divergent_ec: continue 2026-02-17T11:22:27.688 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:256: TEST_divergent_ec: for i in $osds 2026-02-17T11:22:27.689 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:258: TEST_divergent_ec: '[' 2 = 1 ']' 2026-02-17T11:22:27.689 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:261: TEST_divergent_ec: non_divergent=' 0 2' 2026-02-17T11:22:27.689 INFO:tasks.workunit.client.0.trial148.stdout:writing initial objects 2026-02-17T11:22:27.690 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:264: TEST_divergent_ec: echo 'writing initial objects' 2026-02-17T11:22:27.690 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: seq 1 100 2026-02-17T11:22:27.690 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:27.690 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_1 /etc/fstab 2026-02-17T11:22:27.710 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:27.711 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_2 /etc/fstab 2026-02-17T11:22:27.738 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:27.738 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_3 /etc/fstab 2026-02-17T11:22:27.766 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:27.766 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_4 /etc/fstab 2026-02-17T11:22:27.787 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:27.787 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_5 /etc/fstab 2026-02-17T11:22:27.814 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:27.814 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_6 /etc/fstab 2026-02-17T11:22:27.842 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:27.842 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_7 /etc/fstab 2026-02-17T11:22:27.871 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:27.871 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_8 /etc/fstab 2026-02-17T11:22:27.899 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:27.899 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_9 /etc/fstab 2026-02-17T11:22:27.927 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:27.927 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_10 /etc/fstab 2026-02-17T11:22:27.955 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:27.955 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_11 /etc/fstab 2026-02-17T11:22:27.983 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:27.983 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_12 /etc/fstab 2026-02-17T11:22:28.011 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.011 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_13 /etc/fstab 2026-02-17T11:22:28.038 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.038 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_14 /etc/fstab 2026-02-17T11:22:28.066 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.066 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_15 /etc/fstab 2026-02-17T11:22:28.088 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.089 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_16 /etc/fstab 2026-02-17T11:22:28.116 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.117 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_17 /etc/fstab 2026-02-17T11:22:28.135 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.136 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_18 /etc/fstab 2026-02-17T11:22:28.162 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.162 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_19 /etc/fstab 2026-02-17T11:22:28.189 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.189 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_20 /etc/fstab 2026-02-17T11:22:28.219 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.219 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_21 /etc/fstab 2026-02-17T11:22:28.246 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.246 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_22 /etc/fstab 2026-02-17T11:22:28.268 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.268 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_23 /etc/fstab 2026-02-17T11:22:28.295 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.295 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_24 /etc/fstab 2026-02-17T11:22:28.322 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.322 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_25 /etc/fstab 2026-02-17T11:22:28.351 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.351 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_26 /etc/fstab 2026-02-17T11:22:28.370 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.371 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_27 /etc/fstab 2026-02-17T11:22:28.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_28 /etc/fstab 2026-02-17T11:22:28.424 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.425 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_29 /etc/fstab 2026-02-17T11:22:28.452 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.452 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_30 /etc/fstab 2026-02-17T11:22:28.479 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.480 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_31 /etc/fstab 2026-02-17T11:22:28.507 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.507 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_32 /etc/fstab 2026-02-17T11:22:28.532 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.532 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_33 /etc/fstab 2026-02-17T11:22:28.553 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.554 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_34 /etc/fstab 2026-02-17T11:22:28.573 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.574 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_35 /etc/fstab 2026-02-17T11:22:28.593 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.593 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_36 /etc/fstab 2026-02-17T11:22:28.622 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.622 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_37 /etc/fstab 2026-02-17T11:22:28.643 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.643 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_38 /etc/fstab 2026-02-17T11:22:28.664 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.664 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_39 /etc/fstab 2026-02-17T11:22:28.693 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.694 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_40 /etc/fstab 2026-02-17T11:22:28.720 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.720 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_41 /etc/fstab 2026-02-17T11:22:28.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.748 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_42 /etc/fstab 2026-02-17T11:22:28.775 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.776 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_43 /etc/fstab 2026-02-17T11:22:28.803 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.804 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_44 /etc/fstab 2026-02-17T11:22:28.831 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.831 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_45 /etc/fstab 2026-02-17T11:22:28.859 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.860 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_46 /etc/fstab 2026-02-17T11:22:28.887 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.887 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_47 /etc/fstab 2026-02-17T11:22:28.915 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.915 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_48 /etc/fstab 2026-02-17T11:22:28.943 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.943 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_49 /etc/fstab 2026-02-17T11:22:28.963 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.963 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_50 /etc/fstab 2026-02-17T11:22:28.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:28.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_51 /etc/fstab 2026-02-17T11:22:29.017 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.018 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_52 /etc/fstab 2026-02-17T11:22:29.046 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.046 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_53 /etc/fstab 2026-02-17T11:22:29.065 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.065 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_54 /etc/fstab 2026-02-17T11:22:29.093 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.093 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_55 /etc/fstab 2026-02-17T11:22:29.120 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.120 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_56 /etc/fstab 2026-02-17T11:22:29.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.148 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_57 /etc/fstab 2026-02-17T11:22:29.176 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.176 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_58 /etc/fstab 2026-02-17T11:22:29.204 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.204 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_59 /etc/fstab 2026-02-17T11:22:29.231 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.232 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_60 /etc/fstab 2026-02-17T11:22:29.259 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.259 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_61 /etc/fstab 2026-02-17T11:22:29.287 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.287 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_62 /etc/fstab 2026-02-17T11:22:29.315 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.316 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_63 /etc/fstab 2026-02-17T11:22:29.343 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.343 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_64 /etc/fstab 2026-02-17T11:22:29.371 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.372 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_65 /etc/fstab 2026-02-17T11:22:29.400 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.400 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_66 /etc/fstab 2026-02-17T11:22:29.428 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.428 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_67 /etc/fstab 2026-02-17T11:22:29.456 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.456 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_68 /etc/fstab 2026-02-17T11:22:29.484 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.484 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_69 /etc/fstab 2026-02-17T11:22:29.511 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.512 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_70 /etc/fstab 2026-02-17T11:22:29.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_71 /etc/fstab 2026-02-17T11:22:29.567 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.567 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_72 /etc/fstab 2026-02-17T11:22:29.587 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.588 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_73 /etc/fstab 2026-02-17T11:22:29.615 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.615 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_74 /etc/fstab 2026-02-17T11:22:29.641 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.642 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_75 /etc/fstab 2026-02-17T11:22:29.670 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.670 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_76 /etc/fstab 2026-02-17T11:22:29.698 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.698 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_77 /etc/fstab 2026-02-17T11:22:29.726 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.727 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_78 /etc/fstab 2026-02-17T11:22:29.754 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.754 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_79 /etc/fstab 2026-02-17T11:22:29.783 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.783 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_80 /etc/fstab 2026-02-17T11:22:29.811 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.811 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_81 /etc/fstab 2026-02-17T11:22:29.839 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.839 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_82 /etc/fstab 2026-02-17T11:22:29.867 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.867 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_83 /etc/fstab 2026-02-17T11:22:29.896 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.896 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_84 /etc/fstab 2026-02-17T11:22:29.924 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.924 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_85 /etc/fstab 2026-02-17T11:22:29.952 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.952 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_86 /etc/fstab 2026-02-17T11:22:29.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:29.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_87 /etc/fstab 2026-02-17T11:22:30.000 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:30.001 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_88 /etc/fstab 2026-02-17T11:22:30.028 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:30.028 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_89 /etc/fstab 2026-02-17T11:22:30.055 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:30.055 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_90 /etc/fstab 2026-02-17T11:22:30.083 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:30.083 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_91 /etc/fstab 2026-02-17T11:22:30.111 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:30.111 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_92 /etc/fstab 2026-02-17T11:22:30.139 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:30.139 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_93 /etc/fstab 2026-02-17T11:22:30.167 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:30.167 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_94 /etc/fstab 2026-02-17T11:22:30.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:30.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_95 /etc/fstab 2026-02-17T11:22:30.223 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:30.223 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_96 /etc/fstab 2026-02-17T11:22:30.246 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:30.247 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_97 /etc/fstab 2026-02-17T11:22:30.273 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:30.274 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_98 /etc/fstab 2026-02-17T11:22:30.300 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:30.301 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_99 /etc/fstab 2026-02-17T11:22:30.329 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:266: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-17T11:22:30.329 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:268: TEST_divergent_ec: rados -p test put existing_100 /etc/fstab 2026-02-17T11:22:30.356 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:271: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T11:22:30.357 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:271: TEST_divergent_ec: wait_for_clean 2026-02-17T11:22:30.357 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T11:22:30.357 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T11:22:30.357 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T11:22:30.357 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T11:22:30.358 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T11:22:30.358 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T11:22:30.358 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T11:22:30.358 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T11:22:30.358 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T11:22:30.429 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T11:22:30.429 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T11:22:30.429 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T11:22:30.429 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T11:22:30.429 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:22:30.429 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:22:30.626 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:22:30.626 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:22:30.626 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:22:30.626 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:22:30.626 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:22:30.626 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:22:30.704 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=21474836496 2026-02-17T11:22:30.705 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 21474836496 2026-02-17T11:22:30.705 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836496' 2026-02-17T11:22:30.705 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:22:30.705 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:22:30.784 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=42949672974 2026-02-17T11:22:30.784 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 42949672974 2026-02-17T11:22:30.785 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836496 1-42949672974' 2026-02-17T11:22:30.785 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:22:30.785 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:22:30.865 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=64424509452 2026-02-17T11:22:30.865 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 64424509452 2026-02-17T11:22:30.865 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-21474836496 1-42949672974 2-64424509452' 2026-02-17T11:22:30.865 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:22:30.866 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-21474836496 2026-02-17T11:22:30.866 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:22:30.867 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:22:30.867 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-21474836496 2026-02-17T11:22:30.868 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:22:30.869 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=21474836496 2026-02-17T11:22:30.869 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 21474836496 2026-02-17T11:22:30.870 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 21474836496' 2026-02-17T11:22:30.870 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:22:31.076 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836494 -lt 21474836496 2026-02-17T11:22:31.076 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:22:32.077 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:22:32.078 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:22:32.290 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 21474836496 -lt 21474836496 2026-02-17T11:22:32.290 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:22:32.291 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-42949672974 2026-02-17T11:22:32.291 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:22:32.292 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T11:22:32.292 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-42949672974 2026-02-17T11:22:32.293 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:22:32.294 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=42949672974 2026-02-17T11:22:32.294 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 42949672974' 2026-02-17T11:22:32.295 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.1 seq 42949672974 2026-02-17T11:22:32.295 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T11:22:32.492 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 42949672974 -lt 42949672974 2026-02-17T11:22:32.493 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:22:32.493 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-64424509452 2026-02-17T11:22:32.493 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:22:32.494 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:22:32.495 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-64424509452 2026-02-17T11:22:32.496 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:22:32.497 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=64424509452 2026-02-17T11:22:32.497 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 64424509452 2026-02-17T11:22:32.498 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 64424509452' 2026-02-17T11:22:32.498 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:22:32.715 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 64424509452 -lt 64424509452 2026-02-17T11:22:32.715 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T11:22:32.715 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:22:32.716 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:22:32.981 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 == 0 2026-02-17T11:22:32.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:22:32.982 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:22:32.982 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:22:32.982 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:22:32.982 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:22:32.983 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:22:32.983 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:22:33.182 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=1 2026-02-17T11:22:33.183 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:22:33.183 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:22:33.184 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:22:33.455 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 1 = 1 2026-02-17T11:22:33.456 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T11:22:33.456 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T11:22:33.456 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:273: TEST_divergent_ec: get_pg test existing_1 2026-02-17T11:22:33.456 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1093: get_pg: local poolname=test 2026-02-17T11:22:33.456 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1094: get_pg: local objectname=existing_1 2026-02-17T11:22:33.456 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: ceph --format json osd map test existing_1 2026-02-17T11:22:33.456 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1096: get_pg: jq -r .pgid 2026-02-17T11:22:33.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:273: TEST_divergent_ec: local pgid=1.0 2026-02-17T11:22:33.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:276: TEST_divergent_ec: echo 'blackholing osds 0 2' 2026-02-17T11:22:33.660 INFO:tasks.workunit.client.0.trial148.stdout:blackholing osds 0 2 2026-02-17T11:22:33.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T11:22:33.847 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:22:33.848 INFO:tasks.workunit.client.0.trial148.stdout:1.0 100 0 0 0 0 69500 0 0 16 84 16 active+clean 2026-02-17T11:22:13.942922+0000 28'100 28:117 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:22:13.713825+0000 0'0 2026-02-17T11:22:13.713825+0000 0 0 periodic scrub scheduled @ 2026-02-18T12:37:30.258832+0000 0 0 2026-02-17T11:22:33.848 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:22:33.848 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:22:33.848 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:22:33.856 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:278: TEST_divergent_ec: for i in $non_divergent 2026-02-17T11:22:33.857 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:280: TEST_divergent_ec: get_asok_path osd.0 2026-02-17T11:22:33.857 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T11:22:33.857 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T11:22:33.857 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:22:33.857 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:22:33.857 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:22:33.858 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.0.asok 2026-02-17T11:22:33.858 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:280: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T11:22:33.858 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:280: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-17T11:22:33.908 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:22:33.909 INFO:tasks.workunit.client.0.trial148.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T11:22:33.909 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:22:33.914 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:278: TEST_divergent_ec: for i in $non_divergent 2026-02-17T11:22:33.915 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:280: TEST_divergent_ec: get_asok_path osd.2 2026-02-17T11:22:33.915 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2026-02-17T11:22:33.915 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2026-02-17T11:22:33.916 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:22:33.916 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:22:33.916 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:22:33.916 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.2.asok 2026-02-17T11:22:33.916 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:280: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T11:22:33.916 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:280: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-17T11:22:33.966 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:22:33.966 INFO:tasks.workunit.client.0.trial148.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-17T11:22:33.966 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:22:33.971 INFO:tasks.workunit.client.0.trial148.stdout:writing divergent object 2026-02-17T11:22:33.972 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:284: TEST_divergent_ec: echo 'writing divergent object' 2026-02-17T11:22:33.972 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:286: TEST_divergent_ec: sleep 1 2026-02-17T11:22:33.972 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:285: TEST_divergent_ec: rados -p test put existing_100 /etc/resolv.conf 2026-02-17T11:22:34.973 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: rados -p test mksnap snap1 2026-02-17T11:22:34.973 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:287: TEST_divergent_ec: rados -p test put existing_100 /etc/fstab 2026-02-17T11:22:35.045 INFO:tasks.workunit.client.0.trial148.stdout:created pool test snap snap1 2026-02-17T11:22:35.047 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:290: TEST_divergent_ec: sleep 10 2026-02-17T11:22:35.048 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:289: TEST_divergent_ec: expr 100 - 1 2026-02-17T11:22:35.049 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:289: TEST_divergent_ec: rados -p test put existing_99 /etc/fstab 2026-02-17T11:22:45.049 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:291: TEST_divergent_ec: killall -9 rados 2026-02-17T11:22:45.085 INFO:tasks.workunit.client.0.trial148.stderr:rados: no process found 2026-02-17T11:22:45.085 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:294: TEST_divergent_ec: echo 'killing all the osds' 2026-02-17T11:22:45.085 INFO:tasks.workunit.client.0.trial148.stdout:killing all the osds 2026-02-17T11:22:45.085 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:295: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T11:22:45.286 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:22:45.286 INFO:tasks.workunit.client.0.trial148.stdout:1.0 101 0 0 0 0 70195 0 0 14 90 14 active+clean 2026-02-17T11:22:13.942922+0000 29'104 29:123 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:22:13.713825+0000 0'0 2026-02-17T11:22:13.713825+0000 0 0 periodic scrub scheduled @ 2026-02-18T16:29:43.505674+0000 0 0 2026-02-17T11:22:45.286 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:22:45.286 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:22:45.287 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:22:45.294 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd 2026-02-17T11:22:45.295 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:22:45.295 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:22:45.295 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:22:45.295 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:22:45.295 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:22:45.605 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:22:45.605 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:297: TEST_divergent_ec: for i in $osds 2026-02-17T11:22:45.605 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:299: TEST_divergent_ec: ceph osd down osd.0 2026-02-17T11:22:45.854 INFO:tasks.workunit.client.0.trial148.stderr:osd.0 is already down. 2026-02-17T11:22:45.865 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:297: TEST_divergent_ec: for i in $osds 2026-02-17T11:22:45.865 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:299: TEST_divergent_ec: ceph osd down osd.1 2026-02-17T11:22:46.119 INFO:tasks.workunit.client.0.trial148.stderr:osd.1 is already down. 2026-02-17T11:22:46.129 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:297: TEST_divergent_ec: for i in $osds 2026-02-17T11:22:46.129 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:299: TEST_divergent_ec: ceph osd down osd.2 2026-02-17T11:22:46.424 INFO:tasks.workunit.client.0.trial148.stderr:osd.2 is already down. 2026-02-17T11:22:46.434 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:301: TEST_divergent_ec: for i in $non_divergent 2026-02-17T11:22:46.434 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:303: TEST_divergent_ec: ceph osd out osd.0 2026-02-17T11:22:46.698 INFO:tasks.workunit.client.0.trial148.stderr:osd.0 is already out. 2026-02-17T11:22:46.710 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:301: TEST_divergent_ec: for i in $non_divergent 2026-02-17T11:22:46.710 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:303: TEST_divergent_ec: ceph osd out osd.2 2026-02-17T11:22:46.965 INFO:tasks.workunit.client.0.trial148.stderr:osd.2 is already out. 2026-02-17T11:22:46.975 INFO:tasks.workunit.client.0.trial148.stdout:bringing up non_divergent 0 2 2026-02-17T11:22:46.975 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:307: TEST_divergent_ec: echo 'bringing up non_divergent 0 2' 2026-02-17T11:22:46.975 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T11:22:47.172 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:22:47.172 INFO:tasks.workunit.client.0.trial148.stdout:1.0 101 0 0 0 0 70195 0 0 14 90 14 stale+active+clean 2026-02-17T11:22:13.942922+0000 29'104 29:123 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:22:13.713825+0000 0'0 2026-02-17T11:22:13.713825+0000 0 0 periodic scrub scheduled @ 2026-02-18T16:29:43.505674+0000 0 0 2026-02-17T11:22:47.172 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:22:47.172 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:22:47.173 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:22:47.184 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:309: TEST_divergent_ec: for i in $non_divergent 2026-02-17T11:22:47.184 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:311: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-17T11:22:47.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/divergent-priors 2026-02-17T11:22:47.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:22:47.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=0 2026-02-17T11:22:47.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:22:47.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T11:22:47.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:22:47.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:22:47.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:22:47.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:22:47.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T11:22:47.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T11:22:47.186 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:22:47.186 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:22:47.186 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:22:47.186 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:22:47.186 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:22:47.186 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:22:47.186 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:22:47.186 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:22:47.186 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:22:47.186 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:22:47.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:22:47.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:22:47.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:22:47.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:22:47.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:22:47.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:22:47.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:22:47.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:22:47.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:22:47.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:22:47.189 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T11:22:47.189 INFO:tasks.workunit.client.0.trial148.stdout:start osd.0 2026-02-17T11:22:47.190 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.0 2026-02-17T11:22:47.190 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 0 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:22:47.190 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T11:22:47.190 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 0 = 0 ']' 2026-02-17T11:22:47.190 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:22:47.190 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:22:47.190 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:22:47.209 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:47.202+0000 7f12013b78c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:22:47.210 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:47.206+0000 7f12013b78c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:22:47.211 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:47.206+0000 7f12013b78c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:22:47.384 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 0 2026-02-17T11:22:47.385 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:22:47.385 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T11:22:47.385 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:22:47.385 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:22:47.385 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:22:47.385 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:22:47.385 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:22:47.386 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:22:47.386 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:22:47.591 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:22:48.436 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:48.430+0000 7f12013b78c0 -1 Falling back to public interface 2026-02-17T11:22:48.592 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:22:48.593 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:22:48.593 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:22:48.593 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:22:48.594 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:22:48.594 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:22:48.807 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:22:49.809 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:22:49.809 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:22:49.809 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:22:49.810 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:22:49.810 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:22:49.810 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:22:50.017 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:22:51.018 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:22:51.019 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:22:51.019 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:22:51.019 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:22:51.020 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:22:51.020 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:22:51.220 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:22:51.700 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:51.694+0000 7f12013b78c0 -1 osd.0 28 log_to_monitors true 2026-02-17T11:22:52.222 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:22:52.222 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:22:52.222 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:22:52.223 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:22:52.223 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:22:52.223 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:22:52.425 INFO:tasks.workunit.client.0.trial148.stdout:osd.0 up out weight 0 up_from 36 up_thru 0 down_at 30 last_clean_interval [5,28) [v2:127.0.0.1:6802/3567642579,v1:127.0.0.1:6803/3567642579] [v2:127.0.0.1:6804/3567642579,v1:127.0.0.1:6805/3567642579] exists,up 02e759ad-aae7-4421-aea5-d8a4d4e52bb4 2026-02-17T11:22:52.428 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:22:52.428 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:22:52.428 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:22:52.428 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:309: TEST_divergent_ec: for i in $non_divergent 2026-02-17T11:22:52.429 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:311: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-17T11:22:52.429 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/divergent-priors 2026-02-17T11:22:52.429 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:22:52.429 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T11:22:52.429 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:22:52.429 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T11:22:52.429 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:22:52.429 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:22:52.429 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:22:52.429 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:22:52.429 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T11:22:52.430 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T11:22:52.430 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:22:52.430 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:22:52.430 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:22:52.430 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:22:52.430 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:22:52.430 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:22:52.430 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:22:52.430 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:22:52.430 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:22:52.430 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:22:52.430 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:22:52.431 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:22:52.431 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:22:52.431 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:22:52.431 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:22:52.431 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:22:52.431 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:22:52.431 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:22:52.431 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:22:52.431 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:22:52.431 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T11:22:52.432 INFO:tasks.workunit.client.0.trial148.stdout:start osd.2 2026-02-17T11:22:52.433 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T11:22:52.433 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:22:52.433 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T11:22:52.433 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T11:22:52.433 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:22:52.433 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:22:52.433 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:22:52.456 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:52.450+0000 7f00514b88c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:22:52.457 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:52.450+0000 7f00514b88c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:22:52.459 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:52.454+0000 7f00514b88c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:22:52.632 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T11:22:52.633 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:22:52.633 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T11:22:52.633 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:22:52.633 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:22:52.633 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:22:52.633 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:22:52.633 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:22:52.634 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:22:52.634 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:22:52.839 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:22:53.704 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:53.697+0000 7f00514b88c0 -1 Falling back to public interface 2026-02-17T11:22:53.840 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:22:53.841 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:22:53.841 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:22:53.842 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:22:53.842 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:22:53.842 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:22:54.043 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:22:55.056 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:22:55.056 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:22:55.057 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:22:55.058 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:22:55.058 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:22:55.058 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:22:55.249 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:22:56.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:22:56.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:22:56.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:22:56.252 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:22:56.252 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:22:56.252 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:22:56.457 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:22:56.776 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:22:56.769+0000 7f00514b88c0 -1 osd.2 28 log_to_monitors true 2026-02-17T11:22:57.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:22:57.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:22:57.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:22:57.459 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:22:57.460 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:22:57.460 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:22:57.663 INFO:tasks.workunit.client.0.trial148.stdout:osd.2 up out weight 0 up_from 38 up_thru 0 down_at 32 last_clean_interval [15,28) [v2:127.0.0.1:6810/658613296,v1:127.0.0.1:6811/658613296] [v2:127.0.0.1:6812/658613296,v1:127.0.0.1:6813/658613296] exists,up fff8f662-3096-4544-a866-04d1e788f94c 2026-02-17T11:22:57.664 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:22:57.665 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:22:57.665 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:22:57.665 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:313: TEST_divergent_ec: for i in $non_divergent 2026-02-17T11:22:57.665 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:315: TEST_divergent_ec: ceph osd in osd.0 2026-02-17T11:22:57.911 INFO:tasks.workunit.client.0.trial148.stderr:osd.0 is already in. 2026-02-17T11:22:57.919 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:313: TEST_divergent_ec: for i in $non_divergent 2026-02-17T11:22:57.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:315: TEST_divergent_ec: ceph osd in osd.2 2026-02-17T11:22:58.182 INFO:tasks.workunit.client.0.trial148.stderr:osd.2 is already in. 2026-02-17T11:22:58.191 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:318: TEST_divergent_ec: sleep 5 2026-02-17T11:23:03.193 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:322: TEST_divergent_ec: expr 2 + 2 2026-02-17T11:23:03.194 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:322: TEST_divergent_ec: objname=existing_4 2026-02-17T11:23:03.194 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:323: TEST_divergent_ec: echo 'writing non-divergent object existing_4' 2026-02-17T11:23:03.195 INFO:tasks.workunit.client.0.trial148.stdout:writing non-divergent object existing_4 2026-02-17T11:23:03.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:324: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T11:23:03.381 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:23:03.381 INFO:tasks.workunit.client.0.trial148.stdout:1.0 101 0 0 0 0 70195 0 0 14 90 14 stale+active+clean 2026-02-17T11:22:13.942922+0000 29'104 29:123 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:22:13.713825+0000 0'0 2026-02-17T11:22:13.713825+0000 0 0 periodic scrub scheduled @ 2026-02-18T16:29:43.505674+0000 0 0 2026-02-17T11:23:03.381 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:23:03.381 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:23:03.381 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:23:03.389 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:325: TEST_divergent_ec: rados -p test put existing_4 /etc/resolv.conf 2026-02-17T11:23:03.419 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T11:23:03.419 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: wait_for_clean 2026-02-17T11:23:03.419 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T11:23:03.419 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T11:23:03.420 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T11:23:03.421 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T11:23:03.421 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T11:23:03.421 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T11:23:03.421 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T11:23:03.421 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T11:23:03.421 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T11:23:03.492 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T11:23:03.492 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T11:23:03.492 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T11:23:03.492 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T11:23:03.492 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:23:03.492 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:23:03.691 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:23:03.691 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:23:03.691 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:23:03.691 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:23:03.691 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:23:03.691 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:23:03.774 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=154618822661 2026-02-17T11:23:03.775 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 154618822661 2026-02-17T11:23:03.775 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-154618822661' 2026-02-17T11:23:03.775 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:23:03.775 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:23:03.837 INFO:tasks.workunit.client.0.trial148.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-17T11:23:03.840 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq= 2026-02-17T11:23:03.840 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z '' 2026-02-17T11:23:03.840 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: continue 2026-02-17T11:23:03.840 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:23:03.841 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:23:03.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=163208757252 2026-02-17T11:23:03.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 163208757252 2026-02-17T11:23:03.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-154618822661 2-163208757252' 2026-02-17T11:23:03.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:23:03.921 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-154618822661 2026-02-17T11:23:03.921 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:23:03.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:23:03.923 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-154618822661 2026-02-17T11:23:03.923 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:23:03.925 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=154618822661 2026-02-17T11:23:03.925 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 154618822661 2026-02-17T11:23:03.926 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 154618822661' 2026-02-17T11:23:03.926 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:23:04.133 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 154618822659 -lt 154618822661 2026-02-17T11:23:04.133 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:23:05.133 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:23:05.134 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:23:05.333 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 154618822659 -lt 154618822661 2026-02-17T11:23:05.333 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:23:06.334 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T11:23:06.334 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:23:06.546 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 154618822661 -lt 154618822661 2026-02-17T11:23:06.546 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:23:06.547 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-163208757252 2026-02-17T11:23:06.547 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:23:06.548 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:23:06.549 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-163208757252 2026-02-17T11:23:06.549 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:23:06.550 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=163208757252 2026-02-17T11:23:06.551 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 163208757252' 2026-02-17T11:23:06.551 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 163208757252 2026-02-17T11:23:06.551 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:23:06.765 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 163208757252 -lt 163208757252 2026-02-17T11:23:06.765 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T11:23:06.766 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:23:06.766 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:23:07.032 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 == 0 2026-02-17T11:23:07.032 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:23:07.033 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:23:07.033 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:23:07.033 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:23:07.033 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:23:07.033 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:23:07.033 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:23:07.238 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:23:07.239 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:23:07.239 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:23:07.239 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:23:07.506 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:23:07.507 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' -1 2026-02-17T11:23:07.507 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: loop=0 2026-02-17T11:23:07.507 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: num_active_clean=0 2026-02-17T11:23:07.507 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:23:07.507 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.1 2026-02-17T11:23:07.607 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:23:07.607 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:23:07.608 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:23:07.608 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:23:07.609 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:23:07.609 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:23:07.609 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:23:07.609 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:23:07.813 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:23:07.814 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:23:07.814 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:23:07.814 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:23:08.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:23:08.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:23:08.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:23:08.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:23:08.085 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:23:08.085 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:23:08.085 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:23:08.085 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:23:08.085 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:23:08.353 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:23:08.353 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:23:08.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 1 >= 8 )) 2026-02-17T11:23:08.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:23:08.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.2 2026-02-17T11:23:08.554 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:23:08.554 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:23:08.554 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:23:08.554 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:23:08.554 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:23:08.555 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:23:08.555 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:23:08.555 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:23:08.765 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:23:08.765 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:23:08.766 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:23:08.766 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:23:09.032 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:23:09.032 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:23:09.032 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:23:09.032 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:23:09.032 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:23:09.032 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:23:09.033 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:23:09.033 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:23:09.033 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:23:09.297 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:23:09.297 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:23:09.297 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 2 >= 8 )) 2026-02-17T11:23:09.297 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:23:09.297 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.4 2026-02-17T11:23:09.700 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:23:09.700 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:23:09.700 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:23:09.701 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:23:09.701 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:23:09.701 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:23:09.701 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:23:09.701 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:23:09.897 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:23:09.898 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:23:09.898 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:23:09.898 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:23:10.160 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:23:10.161 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:23:10.161 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:23:10.161 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:23:10.161 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:23:10.161 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:23:10.161 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:23:10.161 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:23:10.161 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:23:10.420 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:23:10.421 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:23:10.421 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 3 >= 8 )) 2026-02-17T11:23:10.421 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:23:10.421 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.8 2026-02-17T11:23:11.221 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:23:11.221 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:23:11.221 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:23:11.221 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:23:11.221 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:23:11.222 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:23:11.222 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:23:11.222 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:23:11.416 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:23:11.417 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:23:11.417 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:23:11.417 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:23:11.674 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:23:11.674 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:23:11.675 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:23:11.675 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:23:11.675 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:23:11.675 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:23:11.675 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:23:11.675 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:23:11.675 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:23:11.934 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:23:11.934 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:23:11.934 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 4 >= 8 )) 2026-02-17T11:23:11.934 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:23:11.934 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 1.6 2026-02-17T11:23:13.534 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:23:13.534 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:23:13.535 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:23:13.535 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:23:13.535 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:23:13.535 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:23:13.535 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:23:13.535 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:23:13.731 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:23:13.731 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:23:13.732 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:23:13.732 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:23:13.993 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:23:13.993 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:23:13.993 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:23:13.993 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:23:13.993 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:23:13.993 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:23:13.994 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:23:13.994 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:23:13.994 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:23:14.254 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:23:14.254 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:23:14.254 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 5 >= 8 )) 2026-02-17T11:23:14.254 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:23:14.254 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 3.2 2026-02-17T11:23:17.455 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:23:17.455 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:23:17.456 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:23:17.456 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:23:17.456 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:23:17.456 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:23:17.456 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:23:17.456 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:23:17.661 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:23:17.662 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:23:17.662 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:23:17.662 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:23:17.929 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:23:17.929 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:23:17.929 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:23:17.929 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:23:17.929 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:23:17.929 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:23:17.929 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:23:17.930 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:23:17.930 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:23:18.200 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:23:18.200 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:23:18.201 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 6 >= 8 )) 2026-02-17T11:23:18.201 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:23:18.201 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 6.4 2026-02-17T11:23:24.601 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:23:24.601 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:23:24.602 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:23:24.602 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:23:24.602 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:23:24.602 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:23:24.603 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:23:24.603 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:23:24.801 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:23:24.802 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:23:24.802 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:23:24.802 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:23:25.062 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:23:25.062 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:23:25.062 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:23:25.062 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:23:25.062 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:23:25.062 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:23:25.062 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:23:25.062 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:23:25.063 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:23:25.318 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:23:25.318 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:23:25.318 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 7 >= 8 )) 2026-02-17T11:23:25.318 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:23:25.318 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 7.3 2026-02-17T11:23:32.620 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:23:32.620 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:23:32.620 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:23:32.620 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:23:32.621 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:23:32.621 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:23:32.621 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:23:32.622 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:23:32.820 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:23:32.821 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:23:32.821 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:23:32.822 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:23:33.081 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:23:33.081 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:23:33.081 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:23:33.081 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:23:33.081 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:23:33.081 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:23:33.081 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:23:33.082 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:23:33.082 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:23:33.343 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:23:33.343 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:23:33.343 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 8 >= 8 )) 2026-02-17T11:23:33.344 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1679: wait_for_clean: ceph report 2026-02-17T11:23:33.606 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:23:33.606 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_fingerprint": "e203d76d-2527-4bd4-a8b9-1b702dcc5d3f", 2026-02-17T11:23:33.606 INFO:tasks.workunit.client.0.trial148.stdout: "version": "19.2.3-705-g04cf6dd4", 2026-02-17T11:23:33.607 INFO:tasks.workunit.client.0.trial148.stdout: "commit": "04cf6dd4be446d06026adad18a5fbf5da1fa8c0e", 2026-02-17T11:23:33.607 INFO:tasks.workunit.client.0.trial148.stdout: "timestamp": "2026-02-17T11:23:33.600561+0000", 2026-02-17T11:23:33.607 INFO:tasks.workunit.client.0.trial148.stdout: "tag": "", 2026-02-17T11:23:33.607 INFO:tasks.workunit.client.0.trial148.stdout: "health": { 2026-02-17T11:23:33.607 INFO:tasks.workunit.client.0.trial148.stdout: "status": "HEALTH_WARN", 2026-02-17T11:23:33.607 INFO:tasks.workunit.client.0.trial148.stdout: "checks": { 2026-02-17T11:23:33.607 INFO:tasks.workunit.client.0.trial148.stdout: "OSDMAP_FLAGS": { 2026-02-17T11:23:33.607 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:23:33.607 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:23:33.607 INFO:tasks.workunit.client.0.trial148.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T11:23:33.608 INFO:tasks.workunit.client.0.trial148.stdout: "count": 17 2026-02-17T11:23:33.608 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.608 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [], 2026-02-17T11:23:33.608 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:23:33.608 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.608 INFO:tasks.workunit.client.0.trial148.stdout: "OSD_DOWN": { 2026-02-17T11:23:33.608 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:23:33.608 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:23:33.608 INFO:tasks.workunit.client.0.trial148.stdout: "message": "1 osds down", 2026-02-17T11:23:33.608 INFO:tasks.workunit.client.0.trial148.stdout: "count": 1 2026-02-17T11:23:33.608 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.608 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:23:33.609 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.609 INFO:tasks.workunit.client.0.trial148.stdout: "message": "osd.1 (root=default,host=trial148) is down" 2026-02-17T11:23:33.609 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.609 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.609 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:23:33.609 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.609 INFO:tasks.workunit.client.0.trial148.stdout: "PG_DEGRADED": { 2026-02-17T11:23:33.609 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:23:33.609 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:23:33.609 INFO:tasks.workunit.client.0.trial148.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-17T11:23:33.609 INFO:tasks.workunit.client.0.trial148.stdout: "count": 1 2026-02-17T11:23:33.609 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.610 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:23:33.610 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.610 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-17T11:23:33.610 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.610 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.610 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:23:33.610 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.610 INFO:tasks.workunit.client.0.trial148.stdout: "POOL_APP_NOT_ENABLED": { 2026-02-17T11:23:33.610 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:23:33.610 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:23:33.610 INFO:tasks.workunit.client.0.trial148.stdout: "message": "1 pool(s) do not have an application enabled", 2026-02-17T11:23:33.610 INFO:tasks.workunit.client.0.trial148.stdout: "count": 1 2026-02-17T11:23:33.611 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.611 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:23:33.611 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.611 INFO:tasks.workunit.client.0.trial148.stdout: "message": "application not enabled on pool 'test'" 2026-02-17T11:23:33.611 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.611 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.611 INFO:tasks.workunit.client.0.trial148.stdout: "message": "use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." 2026-02-17T11:23:33.611 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.611 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.611 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:23:33.611 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.611 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.612 INFO:tasks.workunit.client.0.trial148.stdout: "mutes": [] 2026-02-17T11:23:33.612 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.612 INFO:tasks.workunit.client.0.trial148.stdout: "monmap_first_committed": 1, 2026-02-17T11:23:33.612 INFO:tasks.workunit.client.0.trial148.stdout: "monmap_last_committed": 1, 2026-02-17T11:23:33.612 INFO:tasks.workunit.client.0.trial148.stdout: "monmap": { 2026-02-17T11:23:33.612 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 1, 2026-02-17T11:23:33.612 INFO:tasks.workunit.client.0.trial148.stdout: "fsid": "0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a", 2026-02-17T11:23:33.612 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:21:44.887731Z", 2026-02-17T11:23:33.612 INFO:tasks.workunit.client.0.trial148.stdout: "created": "2026-02-17T11:21:44.887731Z", 2026-02-17T11:23:33.612 INFO:tasks.workunit.client.0.trial148.stdout: "min_mon_release": 19, 2026-02-17T11:23:33.612 INFO:tasks.workunit.client.0.trial148.stdout: "min_mon_release_name": "squid", 2026-02-17T11:23:33.612 INFO:tasks.workunit.client.0.trial148.stdout: "election_strategy": 1, 2026-02-17T11:23:33.612 INFO:tasks.workunit.client.0.trial148.stdout: "disallowed_leaders": "", 2026-02-17T11:23:33.613 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode": false, 2026-02-17T11:23:33.613 INFO:tasks.workunit.client.0.trial148.stdout: "tiebreaker_mon": "", 2026-02-17T11:23:33.613 INFO:tasks.workunit.client.0.trial148.stdout: "removed_ranks": "", 2026-02-17T11:23:33.613 INFO:tasks.workunit.client.0.trial148.stdout: "features": { 2026-02-17T11:23:33.613 INFO:tasks.workunit.client.0.trial148.stdout: "persistent": [ 2026-02-17T11:23:33.613 INFO:tasks.workunit.client.0.trial148.stdout: "kraken", 2026-02-17T11:23:33.613 INFO:tasks.workunit.client.0.trial148.stdout: "luminous", 2026-02-17T11:23:33.613 INFO:tasks.workunit.client.0.trial148.stdout: "mimic", 2026-02-17T11:23:33.613 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap-prune", 2026-02-17T11:23:33.613 INFO:tasks.workunit.client.0.trial148.stdout: "nautilus", 2026-02-17T11:23:33.613 INFO:tasks.workunit.client.0.trial148.stdout: "octopus", 2026-02-17T11:23:33.613 INFO:tasks.workunit.client.0.trial148.stdout: "pacific", 2026-02-17T11:23:33.614 INFO:tasks.workunit.client.0.trial148.stdout: "elector-pinging", 2026-02-17T11:23:33.614 INFO:tasks.workunit.client.0.trial148.stdout: "quincy", 2026-02-17T11:23:33.614 INFO:tasks.workunit.client.0.trial148.stdout: "reef", 2026-02-17T11:23:33.614 INFO:tasks.workunit.client.0.trial148.stdout: "squid" 2026-02-17T11:23:33.614 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.614 INFO:tasks.workunit.client.0.trial148.stdout: "optional": [] 2026-02-17T11:23:33.614 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.614 INFO:tasks.workunit.client.0.trial148.stdout: "mons": [ 2026-02-17T11:23:33.614 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.614 INFO:tasks.workunit.client.0.trial148.stdout: "rank": 0, 2026-02-17T11:23:33.614 INFO:tasks.workunit.client.0.trial148.stdout: "name": "a", 2026-02-17T11:23:33.614 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:23:33.615 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:23:33.615 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.615 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:23:33.615 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:7115", 2026-02-17T11:23:33.615 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 0 2026-02-17T11:23:33.615 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.615 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.615 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.615 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T11:23:33.615 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T11:23:33.615 INFO:tasks.workunit.client.0.trial148.stdout: "priority": 0, 2026-02-17T11:23:33.615 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 0, 2026-02-17T11:23:33.615 INFO:tasks.workunit.client.0.trial148.stdout: "crush_location": "{}" 2026-02-17T11:23:33.616 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.616 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.616 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.616 INFO:tasks.workunit.client.0.trial148.stdout: "quorum": [ 2026-02-17T11:23:33.616 INFO:tasks.workunit.client.0.trial148.stdout: 0 2026-02-17T11:23:33.616 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.616 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap": { 2026-02-17T11:23:33.616 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 42, 2026-02-17T11:23:33.616 INFO:tasks.workunit.client.0.trial148.stdout: "fsid": "0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a", 2026-02-17T11:23:33.616 INFO:tasks.workunit.client.0.trial148.stdout: "created": "2026-02-17T11:21:44.971751+0000", 2026-02-17T11:23:33.616 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:22:58.226427+0000", 2026-02-17T11:23:33.616 INFO:tasks.workunit.client.0.trial148.stdout: "last_up_change": "2026-02-17T11:22:56.926925+0000", 2026-02-17T11:23:33.616 INFO:tasks.workunit.client.0.trial148.stdout: "last_in_change": "2026-02-17T11:22:58.124158+0000", 2026-02-17T11:23:33.617 INFO:tasks.workunit.client.0.trial148.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T11:23:33.617 INFO:tasks.workunit.client.0.trial148.stdout: "flags_num": 5800384, 2026-02-17T11:23:33.617 INFO:tasks.workunit.client.0.trial148.stdout: "flags_set": [ 2026-02-17T11:23:33.617 INFO:tasks.workunit.client.0.trial148.stdout: "nodown", 2026-02-17T11:23:33.617 INFO:tasks.workunit.client.0.trial148.stdout: "noin", 2026-02-17T11:23:33.617 INFO:tasks.workunit.client.0.trial148.stdout: "noout", 2026-02-17T11:23:33.617 INFO:tasks.workunit.client.0.trial148.stdout: "pglog_hardlimit", 2026-02-17T11:23:33.617 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snapdirs", 2026-02-17T11:23:33.617 INFO:tasks.workunit.client.0.trial148.stdout: "recovery_deletes", 2026-02-17T11:23:33.617 INFO:tasks.workunit.client.0.trial148.stdout: "sortbitwise" 2026-02-17T11:23:33.617 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.617 INFO:tasks.workunit.client.0.trial148.stdout: "crush_version": 10, 2026-02-17T11:23:33.618 INFO:tasks.workunit.client.0.trial148.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T11:23:33.618 INFO:tasks.workunit.client.0.trial148.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T11:23:33.618 INFO:tasks.workunit.client.0.trial148.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T11:23:33.618 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_snapshot": "", 2026-02-17T11:23:33.618 INFO:tasks.workunit.client.0.trial148.stdout: "pool_max": 1, 2026-02-17T11:23:33.618 INFO:tasks.workunit.client.0.trial148.stdout: "max_osd": 3, 2026-02-17T11:23:33.618 INFO:tasks.workunit.client.0.trial148.stdout: "require_min_compat_client": "luminous", 2026-02-17T11:23:33.618 INFO:tasks.workunit.client.0.trial148.stdout: "min_compat_client": "jewel", 2026-02-17T11:23:33.618 INFO:tasks.workunit.client.0.trial148.stdout: "require_osd_release": "squid", 2026-02-17T11:23:33.618 INFO:tasks.workunit.client.0.trial148.stdout: "allow_crimson": false, 2026-02-17T11:23:33.618 INFO:tasks.workunit.client.0.trial148.stdout: "pools": [ 2026-02-17T11:23:33.618 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.619 INFO:tasks.workunit.client.0.trial148.stdout: "pool": 1, 2026-02-17T11:23:33.619 INFO:tasks.workunit.client.0.trial148.stdout: "pool_name": "test", 2026-02-17T11:23:33.619 INFO:tasks.workunit.client.0.trial148.stdout: "create_time": "2026-02-17T11:22:13.620087+0000", 2026-02-17T11:23:33.619 INFO:tasks.workunit.client.0.trial148.stdout: "flags": 16389, 2026-02-17T11:23:33.619 INFO:tasks.workunit.client.0.trial148.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-17T11:23:33.619 INFO:tasks.workunit.client.0.trial148.stdout: "type": 3, 2026-02-17T11:23:33.619 INFO:tasks.workunit.client.0.trial148.stdout: "size": 3, 2026-02-17T11:23:33.619 INFO:tasks.workunit.client.0.trial148.stdout: "min_size": 2, 2026-02-17T11:23:33.619 INFO:tasks.workunit.client.0.trial148.stdout: "crush_rule": 1, 2026-02-17T11:23:33.619 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_count": 0, 2026-02-17T11:23:33.619 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_target": 0, 2026-02-17T11:23:33.619 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T11:23:33.619 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T11:23:33.620 INFO:tasks.workunit.client.0.trial148.stdout: "is_stretch_pool": false, 2026-02-17T11:23:33.620 INFO:tasks.workunit.client.0.trial148.stdout: "object_hash": 2, 2026-02-17T11:23:33.620 INFO:tasks.workunit.client.0.trial148.stdout: "pg_autoscale_mode": "off", 2026-02-17T11:23:33.620 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num": 1, 2026-02-17T11:23:33.620 INFO:tasks.workunit.client.0.trial148.stdout: "pg_placement_num": 1, 2026-02-17T11:23:33.620 INFO:tasks.workunit.client.0.trial148.stdout: "pg_placement_num_target": 1, 2026-02-17T11:23:33.620 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num_target": 1, 2026-02-17T11:23:33.620 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num_pending": 1, 2026-02-17T11:23:33.620 INFO:tasks.workunit.client.0.trial148.stdout: "last_pg_merge_meta": { 2026-02-17T11:23:33.620 INFO:tasks.workunit.client.0.trial148.stdout: "source_pgid": "0.0", 2026-02-17T11:23:33.620 INFO:tasks.workunit.client.0.trial148.stdout: "ready_epoch": 0, 2026-02-17T11:23:33.620 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_started": 0, 2026-02-17T11:23:33.620 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_clean": 0, 2026-02-17T11:23:33.620 INFO:tasks.workunit.client.0.trial148.stdout: "source_version": "0'0", 2026-02-17T11:23:33.621 INFO:tasks.workunit.client.0.trial148.stdout: "target_version": "0'0" 2026-02-17T11:23:33.621 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.621 INFO:tasks.workunit.client.0.trial148.stdout: "last_change": "29", 2026-02-17T11:23:33.621 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend": "0", 2026-02-17T11:23:33.621 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T11:23:33.621 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T11:23:33.621 INFO:tasks.workunit.client.0.trial148.stdout: "auid": 0, 2026-02-17T11:23:33.621 INFO:tasks.workunit.client.0.trial148.stdout: "snap_mode": "pool", 2026-02-17T11:23:33.621 INFO:tasks.workunit.client.0.trial148.stdout: "snap_seq": 1, 2026-02-17T11:23:33.621 INFO:tasks.workunit.client.0.trial148.stdout: "snap_epoch": 29, 2026-02-17T11:23:33.621 INFO:tasks.workunit.client.0.trial148.stdout: "pool_snaps": [ 2026-02-17T11:23:33.621 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.621 INFO:tasks.workunit.client.0.trial148.stdout: "snapid": 1, 2026-02-17T11:23:33.622 INFO:tasks.workunit.client.0.trial148.stdout: "stamp": "2026-02-17T11:22:34.989339+0000", 2026-02-17T11:23:33.622 INFO:tasks.workunit.client.0.trial148.stdout: "name": "snap1" 2026-02-17T11:23:33.622 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.622 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.622 INFO:tasks.workunit.client.0.trial148.stdout: "removed_snaps": "[]", 2026-02-17T11:23:33.622 INFO:tasks.workunit.client.0.trial148.stdout: "quota_max_bytes": 0, 2026-02-17T11:23:33.622 INFO:tasks.workunit.client.0.trial148.stdout: "quota_max_objects": 0, 2026-02-17T11:23:33.622 INFO:tasks.workunit.client.0.trial148.stdout: "tiers": [], 2026-02-17T11:23:33.622 INFO:tasks.workunit.client.0.trial148.stdout: "tier_of": -1, 2026-02-17T11:23:33.622 INFO:tasks.workunit.client.0.trial148.stdout: "read_tier": -1, 2026-02-17T11:23:33.622 INFO:tasks.workunit.client.0.trial148.stdout: "write_tier": -1, 2026-02-17T11:23:33.622 INFO:tasks.workunit.client.0.trial148.stdout: "cache_mode": "none", 2026-02-17T11:23:33.622 INFO:tasks.workunit.client.0.trial148.stdout: "target_max_bytes": 0, 2026-02-17T11:23:33.623 INFO:tasks.workunit.client.0.trial148.stdout: "target_max_objects": 0, 2026-02-17T11:23:33.623 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T11:23:33.623 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T11:23:33.623 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T11:23:33.623 INFO:tasks.workunit.client.0.trial148.stdout: "cache_min_flush_age": 0, 2026-02-17T11:23:33.623 INFO:tasks.workunit.client.0.trial148.stdout: "cache_min_evict_age": 0, 2026-02-17T11:23:33.623 INFO:tasks.workunit.client.0.trial148.stdout: "erasure_code_profile": "myprofile", 2026-02-17T11:23:33.623 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_params": { 2026-02-17T11:23:33.623 INFO:tasks.workunit.client.0.trial148.stdout: "type": "none" 2026-02-17T11:23:33.623 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.623 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_period": 0, 2026-02-17T11:23:33.623 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_count": 0, 2026-02-17T11:23:33.623 INFO:tasks.workunit.client.0.trial148.stdout: "use_gmt_hitset": true, 2026-02-17T11:23:33.624 INFO:tasks.workunit.client.0.trial148.stdout: "min_read_recency_for_promote": 0, 2026-02-17T11:23:33.624 INFO:tasks.workunit.client.0.trial148.stdout: "min_write_recency_for_promote": 0, 2026-02-17T11:23:33.624 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T11:23:33.624 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_search_last_n": 0, 2026-02-17T11:23:33.624 INFO:tasks.workunit.client.0.trial148.stdout: "grade_table": [], 2026-02-17T11:23:33.624 INFO:tasks.workunit.client.0.trial148.stdout: "stripe_width": 8192, 2026-02-17T11:23:33.624 INFO:tasks.workunit.client.0.trial148.stdout: "expected_num_objects": 0, 2026-02-17T11:23:33.624 INFO:tasks.workunit.client.0.trial148.stdout: "fast_read": false, 2026-02-17T11:23:33.624 INFO:tasks.workunit.client.0.trial148.stdout: "options": {}, 2026-02-17T11:23:33.624 INFO:tasks.workunit.client.0.trial148.stdout: "application_metadata": {} 2026-02-17T11:23:33.624 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.624 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.624 INFO:tasks.workunit.client.0.trial148.stdout: "osds": [ 2026-02-17T11:23:33.625 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.625 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:23:33.625 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "02e759ad-aae7-4421-aea5-d8a4d4e52bb4", 2026-02-17T11:23:33.625 INFO:tasks.workunit.client.0.trial148.stdout: "up": 1, 2026-02-17T11:23:33.625 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:23:33.625 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:23:33.625 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:23:33.625 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 5, 2026-02-17T11:23:33.625 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 28, 2026-02-17T11:23:33.625 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 36, 2026-02-17T11:23:33.625 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 41, 2026-02-17T11:23:33.625 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 30, 2026-02-17T11:23:33.625 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:23:33.626 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:23:33.626 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:23:33.626 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.626 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:23:33.626 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6802", 2026-02-17T11:23:33.626 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3567642579 2026-02-17T11:23:33.626 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.626 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.626 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:23:33.626 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6803", 2026-02-17T11:23:33.626 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3567642579 2026-02-17T11:23:33.626 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.627 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.627 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.627 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:23:33.627 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:23:33.627 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.627 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:23:33.627 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6804", 2026-02-17T11:23:33.627 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3567642579 2026-02-17T11:23:33.627 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.627 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.627 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:23:33.627 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6805", 2026-02-17T11:23:33.627 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3567642579 2026-02-17T11:23:33.628 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.628 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.628 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.628 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:23:33.628 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:23:33.628 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.628 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:23:33.628 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6808", 2026-02-17T11:23:33.628 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3567642579 2026-02-17T11:23:33.628 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.628 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.628 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:23:33.628 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6809", 2026-02-17T11:23:33.629 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3567642579 2026-02-17T11:23:33.629 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.629 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.629 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.629 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:23:33.629 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:23:33.629 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.629 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:23:33.629 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6806", 2026-02-17T11:23:33.629 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3567642579 2026-02-17T11:23:33.629 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.629 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.629 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:23:33.629 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6807", 2026-02-17T11:23:33.630 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3567642579 2026-02-17T11:23:33.630 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.630 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.630 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.630 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6803/3567642579", 2026-02-17T11:23:33.630 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6805/3567642579", 2026-02-17T11:23:33.630 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6809/3567642579", 2026-02-17T11:23:33.630 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6807/3567642579", 2026-02-17T11:23:33.630 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:23:33.630 INFO:tasks.workunit.client.0.trial148.stdout: "exists", 2026-02-17T11:23:33.630 INFO:tasks.workunit.client.0.trial148.stdout: "up" 2026-02-17T11:23:33.630 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.630 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.631 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.631 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:23:33.631 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "1b0c045e-9cdd-417f-946e-6a48f886c5a3", 2026-02-17T11:23:33.631 INFO:tasks.workunit.client.0.trial148.stdout: "up": 0, 2026-02-17T11:23:33.631 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:23:33.631 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:23:33.631 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:23:33.631 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 0, 2026-02-17T11:23:33.631 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 0, 2026-02-17T11:23:33.631 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 10, 2026-02-17T11:23:33.631 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 24, 2026-02-17T11:23:33.631 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 31, 2026-02-17T11:23:33.631 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:23:33.632 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:23:33.632 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:23:33.632 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.632 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:23:33.632 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6810", 2026-02-17T11:23:33.632 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 585555032 2026-02-17T11:23:33.632 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.632 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.632 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:23:33.632 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6811", 2026-02-17T11:23:33.632 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 585555032 2026-02-17T11:23:33.632 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.632 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.633 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.633 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:23:33.633 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:23:33.633 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.633 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:23:33.633 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6812", 2026-02-17T11:23:33.633 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 585555032 2026-02-17T11:23:33.633 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.633 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.633 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:23:33.633 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6813", 2026-02-17T11:23:33.633 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 585555032 2026-02-17T11:23:33.633 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.634 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.634 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.634 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:23:33.634 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:23:33.634 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.634 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:23:33.634 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6816", 2026-02-17T11:23:33.634 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 585555032 2026-02-17T11:23:33.634 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.634 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.634 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:23:33.634 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6817", 2026-02-17T11:23:33.634 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 585555032 2026-02-17T11:23:33.635 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.635 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.635 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.635 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:23:33.635 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:23:33.635 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.635 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:23:33.635 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6814", 2026-02-17T11:23:33.635 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 585555032 2026-02-17T11:23:33.635 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.635 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.635 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:23:33.635 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6815", 2026-02-17T11:23:33.636 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 585555032 2026-02-17T11:23:33.636 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.636 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.636 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.636 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6811/585555032", 2026-02-17T11:23:33.636 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6813/585555032", 2026-02-17T11:23:33.636 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6817/585555032", 2026-02-17T11:23:33.636 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6815/585555032", 2026-02-17T11:23:33.636 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:23:33.636 INFO:tasks.workunit.client.0.trial148.stdout: "exists" 2026-02-17T11:23:33.636 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.636 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.636 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.637 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:23:33.637 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "fff8f662-3096-4544-a866-04d1e788f94c", 2026-02-17T11:23:33.637 INFO:tasks.workunit.client.0.trial148.stdout: "up": 1, 2026-02-17T11:23:33.637 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:23:33.637 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:23:33.637 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:23:33.637 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 15, 2026-02-17T11:23:33.637 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 28, 2026-02-17T11:23:33.637 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 38, 2026-02-17T11:23:33.637 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 0, 2026-02-17T11:23:33.637 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 32, 2026-02-17T11:23:33.637 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:23:33.637 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:23:33.637 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:23:33.638 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.638 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:23:33.638 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6810", 2026-02-17T11:23:33.638 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 658613296 2026-02-17T11:23:33.638 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.638 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.638 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:23:33.638 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6811", 2026-02-17T11:23:33.638 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 658613296 2026-02-17T11:23:33.638 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.638 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.638 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.639 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:23:33.639 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:23:33.639 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.639 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:23:33.639 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6812", 2026-02-17T11:23:33.639 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 658613296 2026-02-17T11:23:33.639 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.639 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.639 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:23:33.639 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6813", 2026-02-17T11:23:33.639 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 658613296 2026-02-17T11:23:33.639 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.639 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.639 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.640 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:23:33.640 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:23:33.640 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.640 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:23:33.640 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6816", 2026-02-17T11:23:33.640 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 658613296 2026-02-17T11:23:33.640 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.640 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.640 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:23:33.640 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6817", 2026-02-17T11:23:33.640 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 658613296 2026-02-17T11:23:33.640 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.640 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.641 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.641 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:23:33.641 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:23:33.641 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.641 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:23:33.641 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6814", 2026-02-17T11:23:33.641 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 658613296 2026-02-17T11:23:33.641 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.641 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.641 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:23:33.641 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6815", 2026-02-17T11:23:33.641 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 658613296 2026-02-17T11:23:33.641 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.641 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.641 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.642 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6811/658613296", 2026-02-17T11:23:33.642 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6813/658613296", 2026-02-17T11:23:33.642 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6817/658613296", 2026-02-17T11:23:33.642 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6815/658613296", 2026-02-17T11:23:33.642 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:23:33.642 INFO:tasks.workunit.client.0.trial148.stdout: "exists", 2026-02-17T11:23:33.642 INFO:tasks.workunit.client.0.trial148.stdout: "up" 2026-02-17T11:23:33.642 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.642 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.643 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.643 INFO:tasks.workunit.client.0.trial148.stdout: "osd_xinfo": [ 2026-02-17T11:23:33.643 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.643 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:23:33.643 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:22:45.797579+0000", 2026-02-17T11:23:33.643 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:23:33.643 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:23:33.643 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:23:33.643 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:23:33.643 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "2026-02-17T11:21:53.799545+0000", 2026-02-17T11:23:33.643 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:23:33.643 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.643 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.644 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:23:33.644 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:22:46.060704+0000", 2026-02-17T11:23:33.644 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:23:33.644 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:23:33.644 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:23:33.644 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:23:33.644 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "2026-02-17T11:22:02.086227+0000", 2026-02-17T11:23:33.644 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:23:33.644 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.644 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.644 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:23:33.644 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:22:46.364443+0000", 2026-02-17T11:23:33.644 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:23:33.644 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:23:33.645 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:23:33.645 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:23:33.645 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "2026-02-17T11:22:11.508964+0000", 2026-02-17T11:23:33.645 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:23:33.645 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.645 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.645 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap": [], 2026-02-17T11:23:33.645 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap_items": [], 2026-02-17T11:23:33.645 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap_primaries": [], 2026-02-17T11:23:33.645 INFO:tasks.workunit.client.0.trial148.stdout: "pg_temp": [], 2026-02-17T11:23:33.645 INFO:tasks.workunit.client.0.trial148.stdout: "primary_temp": [], 2026-02-17T11:23:33.645 INFO:tasks.workunit.client.0.trial148.stdout: "blocklist": {}, 2026-02-17T11:23:33.645 INFO:tasks.workunit.client.0.trial148.stdout: "range_blocklist": {}, 2026-02-17T11:23:33.645 INFO:tasks.workunit.client.0.trial148.stdout: "erasure_code_profiles": { 2026-02-17T11:23:33.646 INFO:tasks.workunit.client.0.trial148.stdout: "default": { 2026-02-17T11:23:33.646 INFO:tasks.workunit.client.0.trial148.stdout: "k": "2", 2026-02-17T11:23:33.646 INFO:tasks.workunit.client.0.trial148.stdout: "m": "2", 2026-02-17T11:23:33.646 INFO:tasks.workunit.client.0.trial148.stdout: "plugin": "jerasure", 2026-02-17T11:23:33.646 INFO:tasks.workunit.client.0.trial148.stdout: "technique": "reed_sol_van" 2026-02-17T11:23:33.646 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.646 INFO:tasks.workunit.client.0.trial148.stdout: "myprofile": { 2026-02-17T11:23:33.646 INFO:tasks.workunit.client.0.trial148.stdout: "crush-device-class": "", 2026-02-17T11:23:33.646 INFO:tasks.workunit.client.0.trial148.stdout: "crush-failure-domain": "osd", 2026-02-17T11:23:33.646 INFO:tasks.workunit.client.0.trial148.stdout: "crush-num-failure-domains": "0", 2026-02-17T11:23:33.646 INFO:tasks.workunit.client.0.trial148.stdout: "crush-osds-per-failure-domain": "0", 2026-02-17T11:23:33.646 INFO:tasks.workunit.client.0.trial148.stdout: "crush-root": "default", 2026-02-17T11:23:33.646 INFO:tasks.workunit.client.0.trial148.stdout: "jerasure-per-chunk-alignment": "false", 2026-02-17T11:23:33.646 INFO:tasks.workunit.client.0.trial148.stdout: "k": "2", 2026-02-17T11:23:33.646 INFO:tasks.workunit.client.0.trial148.stdout: "m": "1", 2026-02-17T11:23:33.646 INFO:tasks.workunit.client.0.trial148.stdout: "plugin": "jerasure", 2026-02-17T11:23:33.647 INFO:tasks.workunit.client.0.trial148.stdout: "technique": "reed_sol_van", 2026-02-17T11:23:33.647 INFO:tasks.workunit.client.0.trial148.stdout: "w": "8" 2026-02-17T11:23:33.647 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.647 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.647 INFO:tasks.workunit.client.0.trial148.stdout: "removed_snaps_queue": [], 2026-02-17T11:23:33.647 INFO:tasks.workunit.client.0.trial148.stdout: "new_removed_snaps": [], 2026-02-17T11:23:33.647 INFO:tasks.workunit.client.0.trial148.stdout: "new_purged_snaps": [], 2026-02-17T11:23:33.647 INFO:tasks.workunit.client.0.trial148.stdout: "crush_node_flags": {}, 2026-02-17T11:23:33.647 INFO:tasks.workunit.client.0.trial148.stdout: "device_class_flags": {}, 2026-02-17T11:23:33.647 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode": { 2026-02-17T11:23:33.647 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode_enabled": false, 2026-02-17T11:23:33.647 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_bucket_count": 0, 2026-02-17T11:23:33.647 INFO:tasks.workunit.client.0.trial148.stdout: "degraded_stretch_mode": 0, 2026-02-17T11:23:33.647 INFO:tasks.workunit.client.0.trial148.stdout: "recovering_stretch_mode": 0, 2026-02-17T11:23:33.648 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode_bucket": 0 2026-02-17T11:23:33.648 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.648 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.648 INFO:tasks.workunit.client.0.trial148.stdout: "osd_metadata": [ 2026-02-17T11:23:33.648 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.648 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:23:33.648 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:23:33.648 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6804/3567642579,v1:127.0.0.1:6805/3567642579]", 2026-02-17T11:23:33.648 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:23:33.648 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:23:33.648 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:23:33.648 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:23:33.648 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:23:33.648 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:23:33.648 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:23:33.648 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:23:33.648 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:23:33.648 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:23:33.649 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:23:33.649 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:23:33.649 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T11:23:33.649 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:23:33.649 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:23:33.649 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:23:33.649 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:23:33.649 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:23:33.649 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:23:33.649 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:23:33.649 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:23:33.649 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:23:33.649 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:23:33.649 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:21:47.411114Z", 2026-02-17T11:23:33.649 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:23:33.649 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:23:33.649 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:23:33.650 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:23:33.650 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:23:33.650 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:23:33.650 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:23:33.650 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6802/3567642579,v1:127.0.0.1:6803/3567642579]", 2026-02-17T11:23:33.650 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:23:33.650 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/3567642579,v1:127.0.0.1:6809/3567642579]", 2026-02-17T11:23:33.650 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/3567642579,v1:127.0.0.1:6807/3567642579]", 2026-02-17T11:23:33.650 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:23:33.650 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:23:33.650 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:23:33.650 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:23:33.650 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:23:33.650 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:23:33.650 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:23:33.650 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:23:33.650 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:23:33.650 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:23:33.651 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T11:23:33.651 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:23:33.651 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:23:33.651 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:23:33.651 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.651 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.651 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:23:33.651 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:23:33.651 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6812/585555032,v1:127.0.0.1:6813/585555032]", 2026-02-17T11:23:33.651 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:23:33.651 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:23:33.651 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:23:33.651 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:23:33.651 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:23:33.651 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:23:33.651 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:23:33.651 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:23:33.651 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:23:33.651 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:23:33.652 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:23:33.652 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:23:33.652 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T11:23:33.652 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:23:33.652 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:23:33.652 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:23:33.652 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:23:33.652 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:23:33.652 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:23:33.652 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:23:33.652 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:23:33.652 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:23:33.652 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:23:33.652 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:21:55.462507Z", 2026-02-17T11:23:33.652 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:23:33.652 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:23:33.652 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:23:33.652 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:23:33.652 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:23:33.653 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:23:33.653 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:23:33.653 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6810/585555032,v1:127.0.0.1:6811/585555032]", 2026-02-17T11:23:33.653 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:23:33.653 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/585555032,v1:127.0.0.1:6817/585555032]", 2026-02-17T11:23:33.653 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/585555032,v1:127.0.0.1:6815/585555032]", 2026-02-17T11:23:33.653 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:23:33.653 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:23:33.653 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:23:33.653 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:23:33.653 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:23:33.653 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:23:33.653 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:23:33.653 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:23:33.653 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:23:33.653 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:23:33.653 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T11:23:33.653 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:23:33.654 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:23:33.654 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:23:33.654 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.654 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.654 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:23:33.654 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:23:33.654 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6812/658613296,v1:127.0.0.1:6813/658613296]", 2026-02-17T11:23:33.654 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:23:33.654 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:23:33.654 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:23:33.654 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:23:33.654 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:23:33.654 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:23:33.654 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:23:33.654 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:23:33.654 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:23:33.654 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:23:33.654 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:23:33.655 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:23:33.655 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T11:23:33.655 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:23:33.655 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:23:33.655 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:23:33.655 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:23:33.655 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:23:33.655 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:23:33.655 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:23:33.655 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:23:33.655 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:23:33.655 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:23:33.655 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:22:04.951310Z", 2026-02-17T11:23:33.655 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:23:33.655 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:23:33.655 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:23:33.655 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:23:33.655 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:23:33.655 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6810/658613296,v1:127.0.0.1:6811/658613296]", 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/658613296,v1:127.0.0.1:6817/658613296]", 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/658613296,v1:127.0.0.1:6815/658613296]", 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.656 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_clean_epochs": { 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: "min_last_epoch_clean": 0, 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_clean": { 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: "per_pool": [] 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: "osd_epochs": [ 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 36 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 38 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_first_committed": 1, 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_last_committed": 42, 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: "crushmap": { 2026-02-17T11:23:33.657 INFO:tasks.workunit.client.0.trial148.stdout: "devices": [ 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.0", 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.1", 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.2", 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: "types": [ 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 0, 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd" 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.658 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: "name": "host" 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 2, 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: "name": "chassis" 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 3, 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: "name": "rack" 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 4, 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: "name": "row" 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 5, 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: "name": "pdu" 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 6, 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: "name": "pod" 2026-02-17T11:23:33.659 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 7, 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: "name": "room" 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 8, 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: "name": "datacenter" 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 9, 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: "name": "zone" 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 10, 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: "name": "region" 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: "name": "root" 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: "buckets": [ 2026-02-17T11:23:33.660 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: "id": -1, 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: "name": "default", 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "root", 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: "id": -3, 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: "id": -2, 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: "name": "default~ssd", 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "root", 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:23:33.661 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: "id": -4, 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: "id": -3, 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: "name": "trial148", 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "host", 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:23:33.662 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 1 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 2 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: "id": -4, 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: "name": "trial148~ssd", 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "host", 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.663 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 1 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 2 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: "rules": [ 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: "rule_id": 0, 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: "rule_name": "replicated_rule", 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: "type": 1, 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: "steps": [ 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: "op": "take", 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: "item": -1, 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: "item_name": "default" 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: "op": "choose_firstn", 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: "num": 0, 2026-02-17T11:23:33.664 INFO:tasks.workunit.client.0.trial148.stdout: "type": "osd" 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: "op": "emit" 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: "rule_id": 1, 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: "rule_name": "test", 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: "type": 3, 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: "steps": [ 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: "op": "set_chooseleaf_tries", 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: "num": 5 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: "op": "set_choose_tries", 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: "num": 100 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: "op": "take", 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: "item": -1, 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: "item_name": "default" 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.665 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.666 INFO:tasks.workunit.client.0.trial148.stderr:report 748707648 2026-02-17T11:23:33.666 INFO:tasks.workunit.client.0.trial148.stdout: "op": "choose_indep", 2026-02-17T11:23:33.666 INFO:tasks.workunit.client.0.trial148.stdout: "num": 0, 2026-02-17T11:23:33.666 INFO:tasks.workunit.client.0.trial148.stdout: "type": "osd" 2026-02-17T11:23:33.666 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.666 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.666 INFO:tasks.workunit.client.0.trial148.stdout: "op": "emit" 2026-02-17T11:23:33.666 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.666 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:23:33.666 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.666 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.666 INFO:tasks.workunit.client.0.trial148.stdout: "tunables": { 2026-02-17T11:23:33.666 INFO:tasks.workunit.client.0.trial148.stdout: "choose_local_tries": 0, 2026-02-17T11:23:33.666 INFO:tasks.workunit.client.0.trial148.stdout: "choose_local_fallback_tries": 0, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "choose_total_tries": 50, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_descend_once": 1, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_vary_r": 1, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_stable": 1, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "msr_descents": 100, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "msr_collision_tries": 100, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "straw_calc_version": 1, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "allowed_bucket_algs": 54, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "profile": "jewel", 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "optimal_tunables": 1, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "legacy_tunables": 0, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "minimum_required_version": "jewel", 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables": 1, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables2": 1, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "has_v2_rules": 1, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables3": 1, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "has_v3_rules": 0, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "has_v4_buckets": 1, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables5": 1, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "has_v5_rules": 0, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "has_msr_rules": 0 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "choose_args": {} 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "fsmap": { 2026-02-17T11:23:33.667 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 1, 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "btime": "2026-02-17T11:21:44:971531+0000", 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "default_fscid": -1, 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "compat": { 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "compat": {}, 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "ro_compat": {}, 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "incompat": { 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "feature_1": "base v0.20", 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "feature_2": "client writeable ranges", 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "feature_4": "dir inode in separate object", 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "feature_8": "no anchor table", 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "feature_9": "file layout v2", 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "feature_10": "snaprealm v2", 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "feature_11": "minor log segments", 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "feature_flags": { 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "enable_multiple": true, 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "ever_enabled_multiple": true 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "standbys": [], 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "filesystems": [] 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "mdsmap_first_committed": 1, 2026-02-17T11:23:33.668 INFO:tasks.workunit.client.0.trial148.stdout: "mdsmap_last_committed": 1, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "auth": { 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "first_committed": 1, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "last_committed": 5, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_secrets": 3 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg": 1, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_active": 1, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_unknown": 0, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_osd": 3, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "pool_sum": { 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "stat_sum": { 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes": 70420, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects": 101, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_clones": 1, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_copies": 303, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing": 0, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_degraded": 101, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_misplaced": 0, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_unfound": 0, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_dirty": 101, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_whiteouts": 0, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_read": 0, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_read_kb": 0, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_write": 101, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_write_kb": 101, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_scrub_errors": 0, 2026-02-17T11:23:33.669 INFO:tasks.workunit.client.0.trial148.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_deep_scrub_errors": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_recovered": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_recovered": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_keys_recovered": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_omap": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_kb": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_kb": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_promote": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_high": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_low": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_some": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_full": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_pinned": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_legacy_snapsets": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_large_omap_objects": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_manifest": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_bytes": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_keys": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_repaired": 0 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "store_stats": { 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "total": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "available": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 0, 2026-02-17T11:23:33.670 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 0, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 0, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 0 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "log_size": 18, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "ondisk_log_size": 18, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "up": 3, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "acting": 3, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "num_store_stats": 0 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "osd_sum": { 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 0, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 0, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "num_pgs": 3, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "num_osds": 3, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_osds": 3, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "kb": 314572800, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used": 83920, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_data": 2140, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_omap": 10, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_meta": 81717, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "kb_avail": 314488880, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "statfs": { 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "total": 322122547200, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "available": 322036613120, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:23:33.671 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 2191360, 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 1543486, 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 10389, 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 83679083 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "hb_peers": [], 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "snap_trim_queue_len": 0, 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "num_snap_trimming": 0, 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "num_shards_repaired": 0, 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "op_queue_age_hist": { 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "histogram": [], 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "upper_bound": 1 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "perf_stat": { 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ms": 0, 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ms": 0, 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ns": 0, 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ns": 0 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "alerts": [], 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "network_ping_times": [] 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "osd_sum_by_class": { 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "ssd": { 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 0, 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 0, 2026-02-17T11:23:33.672 INFO:tasks.workunit.client.0.trial148.stdout: "num_pgs": 3, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "num_osds": 3, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_osds": 3, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "kb": 314572800, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used": 83920, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_data": 2140, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_omap": 10, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_meta": 81717, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "kb_avail": 314488880, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "statfs": { 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "total": 322122547200, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "available": 322036613120, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 2191360, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 1543486, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 10389, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 83679083 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "hb_peers": [], 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "snap_trim_queue_len": 0, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "num_snap_trimming": 0, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "num_shards_repaired": 0, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "op_queue_age_hist": { 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "histogram": [], 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "upper_bound": 1 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "perf_stat": { 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ms": 0, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ms": 0, 2026-02-17T11:23:33.673 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ns": 0, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ns": 0 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "alerts": [], 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "network_ping_times": [] 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "pool_stats": [ 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "poolid": 1, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg": 1, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "stat_sum": { 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes": 70420, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects": 101, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_clones": 1, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_copies": 303, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing": 0, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_degraded": 101, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_misplaced": 0, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_unfound": 0, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_dirty": 101, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_whiteouts": 0, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_read": 0, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_read_kb": 0, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_write": 101, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_write_kb": 101, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_scrub_errors": 0, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_deep_scrub_errors": 0, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_recovered": 0, 2026-02-17T11:23:33.674 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_recovered": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_keys_recovered": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_omap": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_kb": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_kb": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_promote": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_high": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_low": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_some": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_full": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_pinned": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_legacy_snapsets": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_large_omap_objects": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_manifest": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_bytes": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_keys": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_repaired": 0 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "store_stats": { 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "total": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "available": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 1241088, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 1241088, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 0, 2026-02-17T11:23:33.675 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 0 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: "log_size": 18, 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: "ondisk_log_size": 18, 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: "up": 3, 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: "acting": 3, 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: "num_store_stats": 3 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: "osd_stats": [ 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 154618822667 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 42949672977 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 163208757258 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_by_state": [ 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: "state": "active+undersized+degraded", 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: "num": 1 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_by_osd": [ 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2147483647, 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 0, 2026-02-17T11:23:33.676 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 1, 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 0, 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 1, 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 1, 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 1, 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 0, 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 0, 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snaps": [ 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: "pool": 1, 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snaps": {} 2026-02-17T11:23:33.677 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "servicemap": { 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 4, 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:23:03.439843+0000", 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "services": { 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "osd": { 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "daemons": { 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "summary": "", 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "0": { 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "start_epoch": 0, 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "start_stamp": "0.000000", 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "gid": 0, 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "metadata": {}, 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "task_status": {} 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "2": { 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "start_epoch": 0, 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "start_stamp": "0.000000", 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "gid": 0, 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "metadata": {}, 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "task_status": {} 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "mgrstat_first_committed": 1, 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "mgrstat_last_committed": 52, 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "logm_first_committed": 1, 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "logm_last_committed": 257, 2026-02-17T11:23:33.678 INFO:tasks.workunit.client.0.trial148.stdout: "paxos": { 2026-02-17T11:23:33.679 INFO:tasks.workunit.client.0.trial148.stdout: "first_committed": 1, 2026-02-17T11:23:33.679 INFO:tasks.workunit.client.0.trial148.stdout: "last_committed": 362, 2026-02-17T11:23:33.679 INFO:tasks.workunit.client.0.trial148.stdout: "last_pn": 0, 2026-02-17T11:23:33.679 INFO:tasks.workunit.client.0.trial148.stdout: "accepted_pn": 0 2026-02-17T11:23:33.679 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:23:33.679 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:23:33.679 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1680: wait_for_clean: return 1 2026-02-17T11:23:33.679 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-17T11:23:33.679 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.0 2026-02-17T11:23:33.679 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:23:33.679 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:23:33.679 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:23:33.679 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:23:33.679 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:23:33.724 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:23:33.725 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 0 --op log --pgid 1.0 2026-02-17T11:23:33.725 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T11:23:33.725 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T11:23:33.725 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=0 2026-02-17T11:23:33.725 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T11:23:33.725 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/divergent-priors/0 2026-02-17T11:23:33.725 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/0 --op log --pgid 1.0 2026-02-17T11:23:34.381 INFO:tasks.workunit.client.0.trial148.stderr:PG '1.0' not found 2026-02-17T11:23:34.919 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nodown: return 1 2026-02-17T11:23:34.919 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-17T11:23:34.919 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/divergent-priors 2026-02-17T11:23:34.919 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:23:34.919 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=0 2026-02-17T11:23:34.919 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:23:34.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/divergent-priors/0 2026-02-17T11:23:34.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:23:34.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:23:34.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:23:34.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:23:34.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-17T11:23:34.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-17T11:23:34.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:23:34.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:23:34.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:23:34.920 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:23:34.920 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:23:34.921 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:23:34.921 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:23:34.921 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:23:34.921 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:23:34.921 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:23:34.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:23:34.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:23:34.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:23:34.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:23:34.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:23:34.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:23:34.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:23:34.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:23:34.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:23:34.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:23:34.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/divergent-priors/0 2026-02-17T11:23:34.923 INFO:tasks.workunit.client.0.trial148.stdout:start osd.0 2026-02-17T11:23:34.924 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.0 2026-02-17T11:23:34.925 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 0 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:23:34.925 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/divergent-priors/0/whoami 2026-02-17T11:23:34.925 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 0 = 0 ']' 2026-02-17T11:23:34.925 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:23:34.925 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:23:34.925 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:23:34.947 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:23:34.937+0000 7f865183c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:23:34.948 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:23:34.941+0000 7f865183c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:23:34.949 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:23:34.941+0000 7f865183c8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:23:35.124 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 0 2026-02-17T11:23:35.124 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:23:35.124 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T11:23:35.124 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:23:35.124 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:23:35.124 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:23:35.124 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:23:35.125 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:23:35.125 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:23:35.125 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:23:35.326 INFO:tasks.workunit.client.0.trial148.stdout:osd.0 up in weight 1 up_from 36 up_thru 41 down_at 30 last_clean_interval [5,28) [v2:127.0.0.1:6802/3567642579,v1:127.0.0.1:6803/3567642579] [v2:127.0.0.1:6804/3567642579,v1:127.0.0.1:6805/3567642579] exists,up 02e759ad-aae7-4421-aea5-d8a4d4e52bb4 2026-02-17T11:23:35.328 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:23:35.328 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:23:35.328 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:23:35.328 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-17T11:23:35.328 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.2 2026-02-17T11:23:35.328 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:23:35.328 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:23:35.328 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:23:35.329 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:23:35.329 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:23:35.436 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:23:35.436 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 2 --op log --pgid 1.0 2026-02-17T11:23:35.436 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T11:23:35.436 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T11:23:35.436 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=2 2026-02-17T11:23:35.436 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T11:23:35.436 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/divergent-priors/2 2026-02-17T11:23:35.437 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/2 --op log --pgid 1.0 2026-02-17T11:23:36.114 INFO:tasks.workunit.client.0.trial148.stderr:PG '1.0' not found 2026-02-17T11:23:36.285 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:23:36.277+0000 7f865183c8c0 -1 Falling back to public interface 2026-02-17T11:23:36.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nodown: return 1 2026-02-17T11:23:36.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-17T11:23:36.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/divergent-priors 2026-02-17T11:23:36.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:23:36.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T11:23:36.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:23:36.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/divergent-priors/2 2026-02-17T11:23:36.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:23:36.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:23:36.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:23:36.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:23:36.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-17T11:23:36.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-17T11:23:36.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:23:36.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:23:36.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:23:36.660 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:23:36.660 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:23:36.660 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:23:36.660 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:23:36.660 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:23:36.660 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:23:36.662 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:23:36.662 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:23:36.662 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:23:36.662 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:23:36.662 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:23:36.662 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:23:36.662 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:23:36.662 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:23:36.662 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:23:36.662 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:23:36.662 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:23:36.663 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/divergent-priors/2 2026-02-17T11:23:36.663 INFO:tasks.workunit.client.0.trial148.stdout:start osd.2 2026-02-17T11:23:36.664 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T11:23:36.664 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:23:36.664 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/divergent-priors/2/whoami 2026-02-17T11:23:36.664 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T11:23:36.664 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:23:36.664 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:23:36.665 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:23:36.679 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:23:36.669+0000 7f014ae2b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:23:36.680 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:23:36.673+0000 7f014ae2b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:23:36.681 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:23:36.673+0000 7f014ae2b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:23:36.863 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T11:23:36.863 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:23:36.863 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T11:23:36.863 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:23:36.863 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:23:36.863 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:23:36.864 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:23:36.865 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:23:36.865 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:23:36.865 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:23:37.064 INFO:tasks.workunit.client.0.trial148.stdout:osd.2 up in weight 1 up_from 38 up_thru 0 down_at 32 last_clean_interval [15,28) [v2:127.0.0.1:6810/658613296,v1:127.0.0.1:6811/658613296] [v2:127.0.0.1:6812/658613296,v1:127.0.0.1:6813/658613296] exists,up fff8f662-3096-4544-a866-04d1e788f94c 2026-02-17T11:23:37.065 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:23:37.065 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:23:37.065 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:23:37.065 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:336: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 1 --op log --pgid 1.0 2026-02-17T11:23:37.065 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1257: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-17T11:23:37.065 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1258: _objectstore_tool_nodown: shift 2026-02-17T11:23:37.065 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1259: _objectstore_tool_nodown: local id=1 2026-02-17T11:23:37.065 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1260: _objectstore_tool_nodown: shift 2026-02-17T11:23:37.065 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1261: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-17T11:23:37.065 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1264: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op log --pgid 1.0 2026-02-17T11:23:37.742 INFO:tasks.workunit.client.0.trial148.stderr:PG '1.0' not found 2026-02-17T11:23:37.933 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:23:37.925+0000 7f014ae2b8c0 -1 Falling back to public interface 2026-02-17T11:23:38.290 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1265: _objectstore_tool_nodown: return 1 2026-02-17T11:23:38.290 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-17T11:23:38.290 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: wait_for_clean 2026-02-17T11:23:38.290 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T11:23:38.290 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T11:23:38.290 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T11:23:38.290 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 20 .1 2026-02-17T11:23:38.290 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T11:23:38.291 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T11:23:38.291 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T11:23:38.291 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T11:23:38.291 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T11:23:38.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-17T11:23:38.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T11:23:38.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T11:23:38.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T11:23:38.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:23:38.354 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:23:38.562 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:23:38.563 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:23:38.563 INFO:tasks.workunit.client.0.trial148.stderr:2' 2026-02-17T11:23:38.563 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:23:38.563 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:23:38.563 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:23:39.395 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:23:39.385+0000 7f865183c8c0 -1 osd.0 42 log_to_monitors true 2026-02-17T11:23:40.923 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:23:40.913+0000 7f014ae2b8c0 -1 osd.2 42 log_to_monitors true 2026-02-17T11:23:43.654 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=193273528323 2026-02-17T11:23:43.654 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 193273528323 2026-02-17T11:23:43.655 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-193273528323' 2026-02-17T11:23:43.655 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:23:43.655 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:23:43.715 INFO:tasks.workunit.client.0.trial148.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-17T11:23:43.718 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq= 2026-02-17T11:23:43.718 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z '' 2026-02-17T11:23:43.718 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: continue 2026-02-17T11:23:43.718 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:23:43.718 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:23:43.796 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=210453397507 2026-02-17T11:23:43.796 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 210453397507 2026-02-17T11:23:43.796 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-193273528323 2-210453397507' 2026-02-17T11:23:43.796 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:23:43.797 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-193273528323 2026-02-17T11:23:43.797 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:23:43.798 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:23:43.799 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-193273528323 2026-02-17T11:23:43.799 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:23:43.800 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=193273528323 2026-02-17T11:23:43.800 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 193273528323 2026-02-17T11:23:43.801 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 193273528323' 2026-02-17T11:23:43.801 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:23:44.004 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 1 -lt 193273528323 2026-02-17T11:23:44.004 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:23:45.005 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:23:45.005 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:23:45.207 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 1 -lt 193273528323 2026-02-17T11:23:45.207 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:23:46.208 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-17T11:23:46.208 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:23:46.415 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 193273528324 -lt 193273528323 2026-02-17T11:23:46.416 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:23:46.416 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-210453397507 2026-02-17T11:23:46.416 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:23:46.417 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:23:46.418 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-210453397507 2026-02-17T11:23:46.418 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:23:46.420 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=210453397507 2026-02-17T11:23:46.420 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 210453397507' 2026-02-17T11:23:46.420 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 210453397507 2026-02-17T11:23:46.421 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:23:46.621 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 210453397507 -lt 210453397507 2026-02-17T11:23:46.622 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T11:23:46.622 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:23:46.622 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:23:46.881 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 == 0 2026-02-17T11:23:46.881 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:23:46.881 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:23:46.881 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:23:46.881 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:23:46.881 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:23:46.881 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:23:46.881 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:23:47.076 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:23:47.076 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:23:47.077 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:23:47.077 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:23:47.336 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:23:47.337 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' -1 2026-02-17T11:23:47.337 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: loop=0 2026-02-17T11:23:47.337 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: num_active_clean=0 2026-02-17T11:23:47.337 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:23:47.337 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.1 2026-02-17T11:23:47.437 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:23:47.437 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:23:47.438 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:23:47.438 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:23:47.438 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:23:47.439 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:23:47.439 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:23:47.439 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:23:47.639 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:23:47.640 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:23:47.640 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:23:47.640 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:23:47.897 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:23:47.898 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:23:47.898 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:23:47.898 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:23:47.898 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:23:47.898 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:23:47.898 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:23:47.898 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:23:47.898 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:23:48.153 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:23:48.153 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:23:48.153 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 1 >= 8 )) 2026-02-17T11:23:48.153 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:23:48.153 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.2 2026-02-17T11:23:48.356 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:23:48.356 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:23:48.356 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:23:48.357 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:23:48.357 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:23:48.357 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:23:48.357 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:23:48.357 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:23:48.552 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:23:48.553 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:23:48.553 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:23:48.553 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:23:48.812 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:23:48.813 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:23:48.813 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:23:48.813 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:23:48.813 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:23:48.813 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:23:48.813 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:23:48.813 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:23:48.814 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:23:49.071 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:23:49.071 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:23:49.071 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 2 >= 8 )) 2026-02-17T11:23:49.071 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:23:49.071 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.4 2026-02-17T11:23:49.472 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:23:49.472 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:23:49.473 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:23:49.473 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:23:49.473 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:23:49.474 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:23:49.474 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:23:49.474 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:23:49.677 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:23:49.678 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:23:49.678 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:23:49.678 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:23:49.950 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:23:49.950 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:23:49.950 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:23:49.950 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:23:49.950 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:23:49.951 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:23:49.951 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:23:49.951 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:23:49.951 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:23:50.222 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:23:50.222 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:23:50.222 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 3 >= 8 )) 2026-02-17T11:23:50.222 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:23:50.222 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 0.8 2026-02-17T11:23:51.024 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:23:51.024 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:23:51.025 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:23:51.025 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:23:51.025 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:23:51.025 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:23:51.025 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:23:51.026 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:23:51.226 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:23:51.227 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:23:51.227 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:23:51.227 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:23:51.493 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:23:51.493 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:23:51.493 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:23:51.493 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:23:51.493 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:23:51.493 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:23:51.493 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:23:51.493 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:23:51.493 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:23:51.762 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:23:51.762 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:23:51.762 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 4 >= 8 )) 2026-02-17T11:23:51.762 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:23:51.762 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 1.6 2026-02-17T11:23:53.363 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:23:53.363 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:23:53.364 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:23:53.364 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:23:53.364 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:23:53.364 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:23:53.365 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:23:53.365 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:23:53.566 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:23:53.566 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:23:53.567 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:23:53.567 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:23:53.833 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:23:53.834 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:23:53.834 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:23:53.834 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:23:53.834 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:23:53.834 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:23:53.834 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:23:53.834 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:23:53.834 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:23:54.103 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:23:54.103 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:23:54.103 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 5 >= 8 )) 2026-02-17T11:23:54.103 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:23:54.103 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 3.2 2026-02-17T11:23:57.303 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:23:57.304 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:23:57.305 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:23:57.305 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:23:57.305 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:23:57.305 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:23:57.305 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:23:57.305 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:23:57.510 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:23:57.510 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:23:57.511 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:23:57.511 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:23:57.784 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:23:57.784 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:23:57.784 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:23:57.784 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:23:57.784 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:23:57.784 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:23:57.784 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:23:57.784 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:23:57.785 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:23:58.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:23:58.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:23:58.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 6 >= 8 )) 2026-02-17T11:23:58.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:23:58.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 6.4 2026-02-17T11:24:04.451 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:24:04.451 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:24:04.452 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:24:04.452 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:24:04.452 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:24:04.452 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:24:04.452 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:24:04.452 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:24:04.653 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:24:04.653 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:24:04.654 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:24:04.654 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:24:04.917 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:24:04.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:24:04.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:24:04.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:24:04.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:24:04.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:24:04.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:24:04.918 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:24:04.918 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:24:05.173 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:24:05.173 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:24:05.173 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 7 >= 8 )) 2026-02-17T11:24:05.173 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1683: wait_for_clean: eval 2026-02-17T11:24:05.173 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1684: wait_for_clean: sleep 7.3 2026-02-17T11:24:12.474 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1685: wait_for_clean: loop+=1 2026-02-17T11:24:12.474 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:24:12.475 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:24:12.475 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:24:12.475 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:24:12.476 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:24:12.476 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:24:12.476 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:24:12.675 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=0 2026-02-17T11:24:12.675 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:24:12.676 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:24:12.676 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:24:12.937 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 0 = 1 2026-02-17T11:24:12.937 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1673: wait_for_clean: test 0 '!=' 0 2026-02-17T11:24:12.937 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: get_is_making_recovery_progress 2026-02-17T11:24:12.937 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1334: get_is_making_recovery_progress: local recovery_progress 2026-02-17T11:24:12.937 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1335: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-17T11:24:12.937 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1336: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-17T11:24:12.937 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1337: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-17T11:24:12.937 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: ceph --format json status 2026-02-17T11:24:12.937 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-17T11:24:13.196 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1339: get_is_making_recovery_progress: local progress=null 2026-02-17T11:24:13.196 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1340: get_is_making_recovery_progress: test null '!=' null 2026-02-17T11:24:13.197 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: (( 8 >= 8 )) 2026-02-17T11:24:13.197 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1679: wait_for_clean: ceph report 2026-02-17T11:24:13.454 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:24:13.455 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_fingerprint": "e203d76d-2527-4bd4-a8b9-1b702dcc5d3f", 2026-02-17T11:24:13.455 INFO:tasks.workunit.client.0.trial148.stdout: "version": "19.2.3-705-g04cf6dd4", 2026-02-17T11:24:13.455 INFO:tasks.workunit.client.0.trial148.stdout: "commit": "04cf6dd4be446d06026adad18a5fbf5da1fa8c0e", 2026-02-17T11:24:13.455 INFO:tasks.workunit.client.0.trial148.stdout: "timestamp": "2026-02-17T11:24:13.448437+0000", 2026-02-17T11:24:13.455 INFO:tasks.workunit.client.0.trial148.stdout: "tag": "", 2026-02-17T11:24:13.455 INFO:tasks.workunit.client.0.trial148.stdout: "health": { 2026-02-17T11:24:13.455 INFO:tasks.workunit.client.0.trial148.stdout: "status": "HEALTH_WARN", 2026-02-17T11:24:13.455 INFO:tasks.workunit.client.0.trial148.stdout: "checks": { 2026-02-17T11:24:13.455 INFO:tasks.workunit.client.0.trial148.stdout: "OSDMAP_FLAGS": { 2026-02-17T11:24:13.455 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:24:13.455 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:24:13.455 INFO:tasks.workunit.client.0.trial148.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-17T11:24:13.455 INFO:tasks.workunit.client.0.trial148.stdout: "count": 17 2026-02-17T11:24:13.455 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.455 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [], 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: "OSD_DOWN": { 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: "message": "1 osds down", 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: "count": 1 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: "message": "osd.1 (root=default,host=trial148) is down" 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: "PG_DEGRADED": { 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-17T11:24:13.456 INFO:tasks.workunit.client.0.trial148.stdout: "count": 1 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: "POOL_APP_NOT_ENABLED": { 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: "severity": "HEALTH_WARN", 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: "summary": { 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: "message": "1 pool(s) do not have an application enabled", 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: "count": 1 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: "detail": [ 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: "message": "application not enabled on pool 'test'" 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.457 INFO:tasks.workunit.client.0.trial148.stdout: "message": "use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications." 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: "muted": false 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: "mutes": [] 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: "monmap_first_committed": 1, 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: "monmap_last_committed": 1, 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: "monmap": { 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 1, 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: "fsid": "0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a", 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:21:44.887731Z", 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: "created": "2026-02-17T11:21:44.887731Z", 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: "min_mon_release": 19, 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: "min_mon_release_name": "squid", 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: "election_strategy": 1, 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: "disallowed_leaders": "", 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode": false, 2026-02-17T11:24:13.458 INFO:tasks.workunit.client.0.trial148.stdout: "tiebreaker_mon": "", 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: "removed_ranks": "", 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: "features": { 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: "persistent": [ 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: "kraken", 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: "luminous", 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: "mimic", 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap-prune", 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: "nautilus", 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: "octopus", 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: "pacific", 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: "elector-pinging", 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: "quincy", 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: "reef", 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: "squid" 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: "optional": [] 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: "mons": [ 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: "rank": 0, 2026-02-17T11:24:13.459 INFO:tasks.workunit.client.0.trial148.stdout: "name": "a", 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:7115", 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 0 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:7115/0", 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: "priority": 0, 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 0, 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: "crush_location": "{}" 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: "quorum": [ 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: 0 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap": { 2026-02-17T11:24:13.460 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 50, 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "fsid": "0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a", 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "created": "2026-02-17T11:21:44.971751+0000", 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:23:41.294786+0000", 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "last_up_change": "2026-02-17T11:23:41.192518+0000", 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "last_in_change": "2026-02-17T11:22:58.124158+0000", 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "flags_num": 5800384, 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "flags_set": [ 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "nodown", 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "noin", 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "noout", 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "pglog_hardlimit", 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snapdirs", 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "recovery_deletes", 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "sortbitwise" 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "crush_version": 12, 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "full_ratio": 0.99000000953674316, 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-17T11:24:13.461 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_snapshot": "", 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "pool_max": 1, 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "max_osd": 3, 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "require_min_compat_client": "luminous", 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "min_compat_client": "jewel", 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "require_osd_release": "squid", 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "allow_crimson": false, 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "pools": [ 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "pool": 1, 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "pool_name": "test", 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "create_time": "2026-02-17T11:22:13.620087+0000", 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "flags": 16389, 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "type": 3, 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "size": 3, 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "min_size": 2, 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "crush_rule": 1, 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_count": 0, 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_target": 0, 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_barrier": 0, 2026-02-17T11:24:13.462 INFO:tasks.workunit.client.0.trial148.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: "is_stretch_pool": false, 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: "object_hash": 2, 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: "pg_autoscale_mode": "off", 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num": 1, 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: "pg_placement_num": 1, 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: "pg_placement_num_target": 1, 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num_target": 1, 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: "pg_num_pending": 1, 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: "last_pg_merge_meta": { 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: "source_pgid": "0.0", 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: "ready_epoch": 0, 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_started": 0, 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_clean": 0, 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: "source_version": "0'0", 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: "target_version": "0'0" 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: "last_change": "29", 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend": "0", 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-17T11:24:13.463 INFO:tasks.workunit.client.0.trial148.stdout: "last_force_op_resend_preluminous": "0", 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: "auid": 0, 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: "snap_mode": "pool", 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: "snap_seq": 1, 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: "snap_epoch": 29, 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: "pool_snaps": [ 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: "snapid": 1, 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: "stamp": "2026-02-17T11:22:34.989339+0000", 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: "name": "snap1" 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: "removed_snaps": "[]", 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: "quota_max_bytes": 0, 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: "quota_max_objects": 0, 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: "tiers": [], 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: "tier_of": -1, 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: "read_tier": -1, 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: "write_tier": -1, 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: "cache_mode": "none", 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: "target_max_bytes": 0, 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: "target_max_objects": 0, 2026-02-17T11:24:13.464 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "cache_min_flush_age": 0, 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "cache_min_evict_age": 0, 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "erasure_code_profile": "myprofile", 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_params": { 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "type": "none" 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_period": 0, 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_count": 0, 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "use_gmt_hitset": true, 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "min_read_recency_for_promote": 0, 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "min_write_recency_for_promote": 0, 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_grade_decay_rate": 0, 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "hit_set_search_last_n": 0, 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "grade_table": [], 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "stripe_width": 8192, 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "expected_num_objects": 0, 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "fast_read": false, 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "options": {}, 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: "application_metadata": {} 2026-02-17T11:24:13.465 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: "osds": [ 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "02e759ad-aae7-4421-aea5-d8a4d4e52bb4", 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: "up": 1, 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 36, 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 42, 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 45, 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 49, 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 44, 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:24:13.466 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6802", 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3712913273 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6803", 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3712913273 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6804", 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3712913273 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6805", 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3712913273 2026-02-17T11:24:13.467 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6808", 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3712913273 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6809", 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3712913273 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.468 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6806", 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3712913273 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6807", 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3712913273 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6803/3712913273", 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6805/3712913273", 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6809/3712913273", 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6807/3712913273", 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: "exists", 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: "up" 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:24:13.469 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "1b0c045e-9cdd-417f-946e-6a48f886c5a3", 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: "up": 0, 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 0, 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 0, 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 10, 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 24, 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 31, 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6810", 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 585555032 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6811", 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 585555032 2026-02-17T11:24:13.470 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6812", 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 585555032 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6813", 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 585555032 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:24:13.471 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6816", 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 585555032 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6817", 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 585555032 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6814", 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 585555032 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6815", 2026-02-17T11:24:13.472 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 585555032 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6811/585555032", 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6813/585555032", 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6817/585555032", 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6815/585555032", 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: "exists" 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: "uuid": "fff8f662-3096-4544-a866-04d1e788f94c", 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: "up": 1, 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: "in": 1, 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 1, 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: "primary_affinity": 1, 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_begin": 38, 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: "last_clean_end": 42, 2026-02-17T11:24:13.473 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 49, 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: "up_thru": 0, 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: "down_at": 48, 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: "lost_at": 0, 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: "public_addrs": { 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6810", 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3553805623 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6811", 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3553805623 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addrs": { 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:24:13.474 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6812", 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3553805623 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6813", 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3553805623 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addrs": { 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6816", 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3553805623 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6817", 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3553805623 2026-02-17T11:24:13.475 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addrs": { 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: "addrvec": [ 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v2", 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6814", 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3553805623 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: "type": "v1", 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "127.0.0.1:6815", 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: "nonce": 3553805623 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: "public_addr": "127.0.0.1:6811/3553805623", 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: "cluster_addr": "127.0.0.1:6813/3553805623", 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3553805623", 2026-02-17T11:24:13.476 INFO:tasks.workunit.client.0.trial148.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3553805623", 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: "state": [ 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: "exists", 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: "up" 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: "osd_xinfo": [ 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:23:39.545768+0000", 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "2026-02-17T11:21:53.799545+0000", 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:24:13.477 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:22:46.060704+0000", 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "2026-02-17T11:22:02.086227+0000", 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: "down_stamp": "2026-02-17T11:23:41.090897+0000", 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_probability": 0, 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: "laggy_interval": 0, 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: "features": 4540701547738038271, 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: "old_weight": 0, 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: "last_purged_snaps_scrub": "2026-02-17T11:22:11.508964+0000", 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: "dead_epoch": 0 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap": [], 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap_items": [], 2026-02-17T11:24:13.478 INFO:tasks.workunit.client.0.trial148.stdout: "pg_upmap_primaries": [], 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "pg_temp": [], 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "primary_temp": [], 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "blocklist": {}, 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "range_blocklist": {}, 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "erasure_code_profiles": { 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "default": { 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "k": "2", 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "m": "2", 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "plugin": "jerasure", 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "technique": "reed_sol_van" 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "myprofile": { 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "crush-device-class": "", 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "crush-failure-domain": "osd", 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "crush-num-failure-domains": "0", 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "crush-osds-per-failure-domain": "0", 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "crush-root": "default", 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "jerasure-per-chunk-alignment": "false", 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "k": "2", 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "m": "1", 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "plugin": "jerasure", 2026-02-17T11:24:13.479 INFO:tasks.workunit.client.0.trial148.stdout: "technique": "reed_sol_van", 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: "w": "8" 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: "removed_snaps_queue": [], 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: "new_removed_snaps": [], 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: "new_purged_snaps": [], 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: "crush_node_flags": {}, 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: "device_class_flags": {}, 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode": { 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode_enabled": false, 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_bucket_count": 0, 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: "degraded_stretch_mode": 0, 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: "recovering_stretch_mode": 0, 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: "stretch_mode_bucket": 0 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: "osd_metadata": [ 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:24:13.480 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6804/3712913273,v1:127.0.0.1:6805/3712913273]", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:24:13.481 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:21:47.411114Z", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6802/3712913273,v1:127.0.0.1:6803/3712913273]", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6808/3712913273,v1:127.0.0.1:6809/3712913273]", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6806/3712913273,v1:127.0.0.1:6807/3712913273]", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:24:13.482 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/0", 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6812/585555032,v1:127.0.0.1:6813/585555032]", 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:24:13.483 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:21:55.462507Z", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6810/585555032,v1:127.0.0.1:6811/585555032]", 2026-02-17T11:24:13.484 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/585555032,v1:127.0.0.1:6817/585555032]", 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/585555032,v1:127.0.0.1:6815/585555032]", 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/1", 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: "arch": "x86_64", 2026-02-17T11:24:13.485 INFO:tasks.workunit.client.0.trial148.stdout: "back_addr": "[v2:127.0.0.1:6812/3553805623,v1:127.0.0.1:6813/3553805623]", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "back_iface": "", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs": "1", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_db": "0", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_dedicated_wal": "0", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "bluefs_single_shared_device": "1", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocation_from_file": "1", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_allocator": "hybrid", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_access_mode": "file", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_block_size": "4096", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_rotational": "0", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_size": "107374182400", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_support_discard": "1", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_bdev_type": "ssd", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "bluestore_min_alloc_size": "4096", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_release": "squid", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:24:13.486 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_short": "19.2.3-705-g04cf6dd4", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "ceph_version_when_created": "ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable)", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "created_at": "2026-02-17T11:22:04.951310Z", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "default_device_class": "ssd", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD485D", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "devices": "nvme0n1", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "distro": "ubuntu", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "distro_version": "22.04", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "front_addr": "[v2:127.0.0.1:6810/3553805623,v1:127.0.0.1:6811/3553805623]", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "front_iface": "", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3553805623,v1:127.0.0.1:6817/3553805623]", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3553805623,v1:127.0.0.1:6815/3553805623]", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "hostname": "trial148", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "journal_rotational": "0", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "mem_swap_kb": "8388604", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "mem_total_kb": "130961708", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-17T11:24:13.487 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_node": "0", 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: "objectstore_numa_nodes": "0", 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: "os": "Linux", 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: "osd_data": "td/divergent-priors/2", 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: "osd_objectstore": "bluestore", 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: "osdspec_affinity": "", 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: "rotational": "0" 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_clean_epochs": { 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: "min_last_epoch_clean": 25, 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: "last_epoch_clean": { 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: "per_pool": [ 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: "poolid": 1, 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: "floor": 25 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: "osd_epochs": [ 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:24:13.488 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 46 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 50 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_first_committed": 1, 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: "osdmap_last_committed": 50, 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: "crushmap": { 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: "devices": [ 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.0", 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.1", 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:24:13.489 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd.2", 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: "class": "ssd" 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: "types": [ 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 0, 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: "name": "osd" 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: "name": "host" 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 2, 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: "name": "chassis" 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.490 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 3, 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: "name": "rack" 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 4, 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: "name": "row" 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 5, 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: "name": "pdu" 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 6, 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: "name": "pod" 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 7, 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: "name": "room" 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 8, 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: "name": "datacenter" 2026-02-17T11:24:13.491 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 9, 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: "name": "zone" 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 10, 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: "name": "region" 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: "name": "root" 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: "buckets": [ 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: "id": -1, 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: "name": "default", 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "root", 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:24:13.492 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: "id": -3, 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: "id": -2, 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: "name": "default~ssd", 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 11, 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "root", 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: "id": -4, 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:24:13.493 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: "id": -3, 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: "name": "trial148", 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "host", 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 1 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.494 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 2 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: "id": -4, 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: "name": "trial148~ssd", 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: "type_id": 1, 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: "type_name": "host", 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 19206, 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: "alg": "straw2", 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: "hash": "rjenkins1", 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: "items": [ 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: "id": 0, 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 0 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: "id": 1, 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 1 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.495 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: "id": 2, 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: "weight": 6402, 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: "pos": 2 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: "rules": [ 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: "rule_id": 0, 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: "rule_name": "replicated_rule", 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: "type": 1, 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: "steps": [ 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: "op": "take", 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: "item": -1, 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: "item_name": "default" 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: "op": "choose_firstn", 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: "num": 0, 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: "type": "osd" 2026-02-17T11:24:13.496 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: "op": "emit" 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: "rule_id": 1, 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: "rule_name": "test", 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: "type": 3, 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: "steps": [ 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: "op": "set_chooseleaf_tries", 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: "num": 5 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: "op": "set_choose_tries", 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: "num": 100 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.497 INFO:tasks.workunit.client.0.trial148.stdout: "op": "take", 2026-02-17T11:24:13.498 INFO:tasks.workunit.client.0.trial148.stderr:report 564939792 2026-02-17T11:24:13.498 INFO:tasks.workunit.client.0.trial148.stdout: "item": -1, 2026-02-17T11:24:13.498 INFO:tasks.workunit.client.0.trial148.stdout: "item_name": "default" 2026-02-17T11:24:13.498 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.498 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.498 INFO:tasks.workunit.client.0.trial148.stdout: "op": "choose_indep", 2026-02-17T11:24:13.498 INFO:tasks.workunit.client.0.trial148.stdout: "num": 0, 2026-02-17T11:24:13.498 INFO:tasks.workunit.client.0.trial148.stdout: "type": "osd" 2026-02-17T11:24:13.498 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.498 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.498 INFO:tasks.workunit.client.0.trial148.stdout: "op": "emit" 2026-02-17T11:24:13.498 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.498 INFO:tasks.workunit.client.0.trial148.stdout: ] 2026-02-17T11:24:13.498 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.498 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.498 INFO:tasks.workunit.client.0.trial148.stdout: "tunables": { 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "choose_local_tries": 0, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "choose_local_fallback_tries": 0, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "choose_total_tries": 50, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_descend_once": 1, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_vary_r": 1, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "chooseleaf_stable": 1, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "msr_descents": 100, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "msr_collision_tries": 100, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "straw_calc_version": 1, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "allowed_bucket_algs": 54, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "profile": "jewel", 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "optimal_tunables": 1, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "legacy_tunables": 0, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "minimum_required_version": "jewel", 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables": 1, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables2": 1, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "has_v2_rules": 1, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables3": 1, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "has_v3_rules": 0, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "has_v4_buckets": 1, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "require_feature_tunables5": 1, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "has_v5_rules": 0, 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: "has_msr_rules": 0 2026-02-17T11:24:13.499 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "choose_args": {} 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "fsmap": { 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 1, 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "btime": "2026-02-17T11:21:44:971531+0000", 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "default_fscid": -1, 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "compat": { 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "compat": {}, 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "ro_compat": {}, 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "incompat": { 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "feature_1": "base v0.20", 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "feature_2": "client writeable ranges", 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "feature_3": "default file layouts on dirs", 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "feature_4": "dir inode in separate object", 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "feature_5": "mds uses versioned encoding", 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "feature_8": "no anchor table", 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "feature_9": "file layout v2", 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "feature_10": "snaprealm v2", 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "feature_11": "minor log segments", 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "feature_12": "quiesce subvolumes" 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "feature_flags": { 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "enable_multiple": true, 2026-02-17T11:24:13.500 INFO:tasks.workunit.client.0.trial148.stdout: "ever_enabled_multiple": true 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "standbys": [], 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "filesystems": [] 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "mdsmap_first_committed": 1, 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "mdsmap_last_committed": 1, 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "auth": { 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "first_committed": 1, 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "last_committed": 5, 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "num_secrets": 3 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg": 1, 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_active": 1, 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_unknown": 0, 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "num_osd": 3, 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "pool_sum": { 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "stat_sum": { 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes": 70420, 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects": 101, 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_clones": 1, 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_copies": 303, 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing": 0, 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_degraded": 101, 2026-02-17T11:24:13.501 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_misplaced": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_unfound": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_dirty": 101, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_whiteouts": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_read": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_read_kb": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_write": 101, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_write_kb": 101, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_scrub_errors": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_deep_scrub_errors": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_recovered": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_recovered": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_keys_recovered": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_omap": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_kb": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_kb": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_promote": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_high": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_low": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_some": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_full": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_pinned": 0, 2026-02-17T11:24:13.502 INFO:tasks.workunit.client.0.trial148.stdout: "num_legacy_snapsets": 0, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_large_omap_objects": 0, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_manifest": 0, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_bytes": 0, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_keys": 0, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_repaired": 0 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "store_stats": { 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "total": 0, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "available": 0, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 0, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 0, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 0, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 0 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "log_size": 18, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "ondisk_log_size": 18, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "up": 3, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "acting": 3, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_store_stats": 0 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "osd_sum": { 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 0, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 0, 2026-02-17T11:24:13.503 INFO:tasks.workunit.client.0.trial148.stdout: "num_pgs": 3, 2026-02-17T11:24:13.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_osds": 3, 2026-02-17T11:24:13.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_osds": 3, 2026-02-17T11:24:13.504 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T11:24:13.504 INFO:tasks.workunit.client.0.trial148.stdout: "kb": 314572800, 2026-02-17T11:24:13.504 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used": 85100, 2026-02-17T11:24:13.504 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_data": 2268, 2026-02-17T11:24:13.504 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_omap": 15, 2026-02-17T11:24:13.504 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_meta": 82736, 2026-02-17T11:24:13.504 INFO:tasks.workunit.client.0.trial148.stdout: "kb_avail": 314487700, 2026-02-17T11:24:13.504 INFO:tasks.workunit.client.0.trial148.stdout: "statfs": { 2026-02-17T11:24:13.504 INFO:tasks.workunit.client.0.trial148.stdout: "total": 322122547200, 2026-02-17T11:24:13.504 INFO:tasks.workunit.client.0.trial148.stdout: "available": 322035404800, 2026-02-17T11:24:13.504 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:24:13.504 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 2322432, 2026-02-17T11:24:13.504 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 1598354, 2026-02-17T11:24:13.504 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:24:13.505 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:24:13.505 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:24:13.505 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 16252, 2026-02-17T11:24:13.505 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 84721796 2026-02-17T11:24:13.505 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.505 INFO:tasks.workunit.client.0.trial148.stdout: "hb_peers": [], 2026-02-17T11:24:13.505 INFO:tasks.workunit.client.0.trial148.stdout: "snap_trim_queue_len": 0, 2026-02-17T11:24:13.505 INFO:tasks.workunit.client.0.trial148.stdout: "num_snap_trimming": 0, 2026-02-17T11:24:13.505 INFO:tasks.workunit.client.0.trial148.stdout: "num_shards_repaired": 0, 2026-02-17T11:24:13.505 INFO:tasks.workunit.client.0.trial148.stdout: "op_queue_age_hist": { 2026-02-17T11:24:13.505 INFO:tasks.workunit.client.0.trial148.stdout: "histogram": [], 2026-02-17T11:24:13.505 INFO:tasks.workunit.client.0.trial148.stdout: "upper_bound": 1 2026-02-17T11:24:13.505 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.505 INFO:tasks.workunit.client.0.trial148.stdout: "perf_stat": { 2026-02-17T11:24:13.505 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ms": 0, 2026-02-17T11:24:13.506 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ms": 0, 2026-02-17T11:24:13.506 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ns": 0, 2026-02-17T11:24:13.506 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ns": 0 2026-02-17T11:24:13.506 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.506 INFO:tasks.workunit.client.0.trial148.stdout: "alerts": [], 2026-02-17T11:24:13.506 INFO:tasks.workunit.client.0.trial148.stdout: "network_ping_times": [] 2026-02-17T11:24:13.506 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.506 INFO:tasks.workunit.client.0.trial148.stdout: "osd_sum_by_class": { 2026-02-17T11:24:13.506 INFO:tasks.workunit.client.0.trial148.stdout: "ssd": { 2026-02-17T11:24:13.506 INFO:tasks.workunit.client.0.trial148.stdout: "up_from": 0, 2026-02-17T11:24:13.506 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 0, 2026-02-17T11:24:13.506 INFO:tasks.workunit.client.0.trial148.stdout: "num_pgs": 3, 2026-02-17T11:24:13.506 INFO:tasks.workunit.client.0.trial148.stdout: "num_osds": 3, 2026-02-17T11:24:13.507 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_osds": 3, 2026-02-17T11:24:13.507 INFO:tasks.workunit.client.0.trial148.stdout: "num_per_pool_omap_osds": 3, 2026-02-17T11:24:13.507 INFO:tasks.workunit.client.0.trial148.stdout: "kb": 314572800, 2026-02-17T11:24:13.507 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used": 85100, 2026-02-17T11:24:13.507 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_data": 2268, 2026-02-17T11:24:13.507 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_omap": 15, 2026-02-17T11:24:13.507 INFO:tasks.workunit.client.0.trial148.stdout: "kb_used_meta": 82736, 2026-02-17T11:24:13.507 INFO:tasks.workunit.client.0.trial148.stdout: "kb_avail": 314487700, 2026-02-17T11:24:13.507 INFO:tasks.workunit.client.0.trial148.stdout: "statfs": { 2026-02-17T11:24:13.507 INFO:tasks.workunit.client.0.trial148.stdout: "total": 322122547200, 2026-02-17T11:24:13.507 INFO:tasks.workunit.client.0.trial148.stdout: "available": 322035404800, 2026-02-17T11:24:13.508 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:24:13.508 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 2322432, 2026-02-17T11:24:13.508 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 1598354, 2026-02-17T11:24:13.508 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:24:13.508 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:24:13.508 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:24:13.508 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 16252, 2026-02-17T11:24:13.508 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 84721796 2026-02-17T11:24:13.508 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.508 INFO:tasks.workunit.client.0.trial148.stdout: "hb_peers": [], 2026-02-17T11:24:13.508 INFO:tasks.workunit.client.0.trial148.stdout: "snap_trim_queue_len": 0, 2026-02-17T11:24:13.508 INFO:tasks.workunit.client.0.trial148.stdout: "num_snap_trimming": 0, 2026-02-17T11:24:13.508 INFO:tasks.workunit.client.0.trial148.stdout: "num_shards_repaired": 0, 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "op_queue_age_hist": { 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "histogram": [], 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "upper_bound": 1 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "perf_stat": { 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ms": 0, 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ms": 0, 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "commit_latency_ns": 0, 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "apply_latency_ns": 0 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "alerts": [], 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "network_ping_times": [] 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "pool_stats": [ 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "poolid": 1, 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg": 1, 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "stat_sum": { 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes": 70420, 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects": 101, 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_clones": 1, 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "num_object_copies": 303, 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing_on_primary": 0, 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_missing": 0, 2026-02-17T11:24:13.509 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_degraded": 101, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_misplaced": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_unfound": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_dirty": 101, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_whiteouts": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_read": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_read_kb": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_write": 101, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_write_kb": 101, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_scrub_errors": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_shallow_scrub_errors": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_deep_scrub_errors": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_recovered": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_recovered": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_keys_recovered": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_omap": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_hit_set_archive": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_bytes_hit_set_archive": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_kb": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_kb": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_promote": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_high": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_flush_mode_low": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_some": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_evict_mode_full": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_pinned": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_legacy_snapsets": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_large_omap_objects": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_manifest": 0, 2026-02-17T11:24:13.510 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_bytes": 0, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "num_omap_keys": 0, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "num_objects_repaired": 0 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "store_stats": { 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "total": 0, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "available": 0, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "internally_reserved": 0, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "allocated": 1241088, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "data_stored": 1241088, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed": 0, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_allocated": 0, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "data_compressed_original": 0, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "omap_allocated": 0, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "internal_metadata": 0 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "log_size": 18, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "ondisk_log_size": 18, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "up": 3, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "acting": 3, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "num_store_stats": 3 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "osd_stats": [ 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 193273528329 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 42949672977 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:24:13.511 INFO:tasks.workunit.client.0.trial148.stdout: "seq": 210453397513 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_by_state": [ 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "state": "active+undersized+degraded", 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "num": 1 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "num_pg_by_osd": [ 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2147483647, 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 0, 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 1, 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 2, 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 0, 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 1, 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 0, 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 1, 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 1, 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "osd": 1, 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "num_primary_pg": 0, 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "num_acting_pg": 0, 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: "num_up_not_acting_pg": 0 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.512 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snaps": [ 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: { 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "pool": 1, 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "purged_snaps": {} 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: ], 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "servicemap": { 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "epoch": 4, 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "modified": "2026-02-17T11:23:03.439843+0000", 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "services": { 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "osd": { 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "daemons": { 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "summary": "", 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "0": { 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "start_epoch": 0, 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "start_stamp": "0.000000", 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "gid": 0, 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "metadata": {}, 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "task_status": {} 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "2": { 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "start_epoch": 0, 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "start_stamp": "0.000000", 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "gid": 0, 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "metadata": {}, 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "task_status": {} 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: }, 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "mgrstat_first_committed": 1, 2026-02-17T11:24:13.513 INFO:tasks.workunit.client.0.trial148.stdout: "mgrstat_last_committed": 71, 2026-02-17T11:24:13.514 INFO:tasks.workunit.client.0.trial148.stdout: "logm_first_committed": 1, 2026-02-17T11:24:13.514 INFO:tasks.workunit.client.0.trial148.stdout: "logm_last_committed": 337, 2026-02-17T11:24:13.514 INFO:tasks.workunit.client.0.trial148.stdout: "paxos": { 2026-02-17T11:24:13.514 INFO:tasks.workunit.client.0.trial148.stdout: "first_committed": 1, 2026-02-17T11:24:13.514 INFO:tasks.workunit.client.0.trial148.stdout: "last_committed": 468, 2026-02-17T11:24:13.514 INFO:tasks.workunit.client.0.trial148.stdout: "last_pn": 0, 2026-02-17T11:24:13.514 INFO:tasks.workunit.client.0.trial148.stdout: "accepted_pn": 0 2026-02-17T11:24:13.514 INFO:tasks.workunit.client.0.trial148.stdout: } 2026-02-17T11:24:13.514 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:24:13.514 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1680: wait_for_clean: return 1 2026-02-17T11:24:13.514 INFO:tasks.workunit.client.0.trial148.stdout:delay recovery 2026-02-17T11:24:13.514 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:341: TEST_divergent_ec: echo 'delay recovery' 2026-02-17T11:24:13.514 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:342: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T11:24:13.666 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:24:13.666 INFO:tasks.workunit.client.0.trial148.stdout:1.0 101 0 101 0 0 70420 0 0 18 84 18 active+undersized+degraded 2026-02-17T11:23:41.302414+0000 42'102 50:139 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T11:22:13.713825+0000 0'0 2026-02-17T11:22:13.713825+0000 0 0 no scrub is scheduled 0 0 2026-02-17T11:24:13.666 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:24:13.666 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:24:13.666 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:24:13.676 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-17T11:24:13.677 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.0 2026-02-17T11:24:13.677 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.0 2026-02-17T11:24:13.677 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.0 ']' 2026-02-17T11:24:13.677 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:24:13.677 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:24:13.678 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:24:13.678 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.0.asok 2026-02-17T11:24:13.678 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T11:24:13.678 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.0.asok set_recovery_delay 100000 2026-02-17T11:24:13.735 INFO:tasks.workunit.client.0.trial148.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T11:24:13.742 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-17T11:24:13.742 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.2 2026-02-17T11:24:13.742 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.2 2026-02-17T11:24:13.743 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.2 ']' 2026-02-17T11:24:13.743 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:24:13.744 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:24:13.744 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:24:13.744 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.2.asok 2026-02-17T11:24:13.744 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T11:24:13.744 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.2.asok set_recovery_delay 100000 2026-02-17T11:24:13.796 INFO:tasks.workunit.client.0.trial148.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T11:24:13.802 INFO:tasks.workunit.client.0.trial148.stdout:revive divergent 1 2026-02-17T11:24:13.803 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:349: TEST_divergent_ec: echo 'revive divergent 1' 2026-02-17T11:24:13.803 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:350: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T11:24:14.008 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:24:14.008 INFO:tasks.workunit.client.0.trial148.stdout:1.0 101 0 101 0 0 70420 0 0 18 84 18 active+undersized+degraded 2026-02-17T11:23:41.302414+0000 42'102 50:139 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T11:22:13.713825+0000 0'0 2026-02-17T11:22:13.713825+0000 0 0 no scrub is scheduled 0 0 2026-02-17T11:24:14.008 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:24:14.008 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:24:14.009 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:24:14.017 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:351: TEST_divergent_ec: ceph osd set noup 2026-02-17T11:24:14.339 INFO:tasks.workunit.client.0.trial148.stderr:noup is set 2026-02-17T11:24:14.351 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:352: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-17T11:24:14.351 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/divergent-priors 2026-02-17T11:24:14.351 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:24:14.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T11:24:14.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:24:14.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T11:24:14.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:24:14.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:24:14.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:24:14.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:24:14.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T11:24:14.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T11:24:14.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:24:14.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:24:14.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:24:14.352 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:24:14.352 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:24:14.352 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:24:14.352 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:24:14.352 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:24:14.352 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:24:14.353 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:24:14.353 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:24:14.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:24:14.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:24:14.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:24:14.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:24:14.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:24:14.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:24:14.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:24:14.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:24:14.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:24:14.354 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T11:24:14.354 INFO:tasks.workunit.client.0.trial148.stdout:start osd.1 2026-02-17T11:24:14.355 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T11:24:14.355 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:24:14.355 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T11:24:14.355 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T11:24:14.355 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:24:14.356 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:24:14.356 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:24:14.380 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:24:14.368+0000 7fe226d778c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:24:14.381 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:24:14.372+0000 7fe226d778c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:24:14.382 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:24:14.372+0000 7fe226d778c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:24:14.553 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:880: activate_osd: return 0 2026-02-17T11:24:14.554 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:353: TEST_divergent_ec: sleep 5 2026-02-17T11:24:15.633 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:24:15.624+0000 7fe226d778c0 -1 Falling back to public interface 2026-02-17T11:24:18.679 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:24:18.668+0000 7fe226d778c0 -1 osd.1 29 log_to_monitors true 2026-02-17T11:24:19.555 INFO:tasks.workunit.client.0.trial148.stdout:delay recovery divergent 2026-02-17T11:24:19.555 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:355: TEST_divergent_ec: echo 'delay recovery divergent' 2026-02-17T11:24:19.555 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:356: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T11:24:19.746 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:24:19.746 INFO:tasks.workunit.client.0.trial148.stdout:1.0 101 0 101 0 0 70420 0 0 18 84 18 active+undersized+degraded 2026-02-17T11:23:41.302414+0000 42'102 52:143 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T11:22:13.713825+0000 0'0 2026-02-17T11:22:13.713825+0000 0 0 periodic scrub scheduled @ 2026-02-18T19:17:24.720207+0000 0 0 2026-02-17T11:24:19.746 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:24:19.746 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:24:19.747 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:24:19.756 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: get_asok_path osd.1 2026-02-17T11:24:19.756 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=osd.1 2026-02-17T11:24:19.756 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n osd.1 ']' 2026-02-17T11:24:19.756 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:24:19.756 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:24:19.756 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:24:19.756 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.19803/ceph-osd.1.asok 2026-02-17T11:24:19.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: CEPH_ARGS= 2026-02-17T11:24:19.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.19803/ceph-osd.1.asok set_recovery_delay 100000 2026-02-17T11:24:19.811 INFO:tasks.workunit.client.0.trial148.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-17T11:24:19.817 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:359: TEST_divergent_ec: ceph osd unset noup 2026-02-17T11:24:20.130 INFO:tasks.workunit.client.0.trial148.stderr:noup is unset 2026-02-17T11:24:20.142 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:361: TEST_divergent_ec: wait_for_osd up 0 2026-02-17T11:24:20.142 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:24:20.142 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T11:24:20.142 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:24:20.142 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:24:20.142 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:24:20.142 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:24:20.143 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:24:20.143 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:24:20.143 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:24:20.349 INFO:tasks.workunit.client.0.trial148.stdout:osd.0 up in weight 1 up_from 45 up_thru 49 down_at 44 last_clean_interval [36,42) [v2:127.0.0.1:6802/3712913273,v1:127.0.0.1:6803/3712913273] [v2:127.0.0.1:6804/3712913273,v1:127.0.0.1:6805/3712913273] exists,up 02e759ad-aae7-4421-aea5-d8a4d4e52bb4 2026-02-17T11:24:20.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:24:20.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:24:20.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:24:20.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:362: TEST_divergent_ec: wait_for_osd up 1 2026-02-17T11:24:20.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:24:20.350 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T11:24:20.351 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:24:20.351 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:24:20.351 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:24:20.351 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:24:20.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:24:20.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:24:20.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:24:20.559 INFO:tasks.workunit.client.0.trial148.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 31 last_clean_interval [10,29) [v2:127.0.0.1:6818/2972933085,v1:127.0.0.1:6819/2972933085] [v2:127.0.0.1:6820/2972933085,v1:127.0.0.1:6821/2972933085] exists,up 1b0c045e-9cdd-417f-946e-6a48f886c5a3 2026-02-17T11:24:20.560 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:24:20.560 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:24:20.561 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:24:20.561 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:363: TEST_divergent_ec: wait_for_osd up 2 2026-02-17T11:24:20.561 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:24:20.561 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T11:24:20.561 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:24:20.561 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:24:20.561 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:24:20.561 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:24:20.562 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:24:20.562 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:24:20.562 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:24:20.763 INFO:tasks.workunit.client.0.trial148.stdout:osd.2 up in weight 1 up_from 49 up_thru 0 down_at 48 last_clean_interval [38,42) [v2:127.0.0.1:6810/3553805623,v1:127.0.0.1:6811/3553805623] [v2:127.0.0.1:6812/3553805623,v1:127.0.0.1:6813/3553805623] exists,up fff8f662-3096-4544-a866-04d1e788f94c 2026-02-17T11:24:20.764 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:24:20.764 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:24:20.764 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:24:20.764 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:365: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T11:24:20.956 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:24:20.957 INFO:tasks.workunit.client.0.trial148.stdout:1.0 101 0 101 0 0 70420 0 0 18 84 18 active+undersized+degraded 2026-02-17T11:23:41.302414+0000 42'102 53:145 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T11:22:13.713825+0000 0'0 2026-02-17T11:22:13.713825+0000 0 0 periodic scrub scheduled @ 2026-02-18T19:17:24.720207+0000 0 0 2026-02-17T11:24:20.957 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:24:20.957 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:24:20.957 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:24:20.965 INFO:tasks.workunit.client.0.trial148.stdout:wait for peering 2026-02-17T11:24:20.965 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:366: TEST_divergent_ec: echo 'wait for peering' 2026-02-17T11:24:20.965 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:367: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T11:24:21.172 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:24:21.172 INFO:tasks.workunit.client.0.trial148.stdout:1.0 101 0 101 0 0 70420 0 0 18 84 18 active+undersized+degraded 2026-02-17T11:23:41.302414+0000 42'102 53:145 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T11:22:13.713825+0000 0'0 2026-02-17T11:22:13.713825+0000 0 0 periodic scrub scheduled @ 2026-02-18T19:17:24.720207+0000 0 0 2026-02-17T11:24:21.172 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:24:21.172 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:24:21.173 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:24:21.181 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:368: TEST_divergent_ec: rados -p test put foo /etc/fstab 2026-02-17T11:24:21.533 INFO:tasks.workunit.client.0.trial148.stdout:killing divergent 1 2026-02-17T11:24:21.533 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:370: TEST_divergent_ec: echo 'killing divergent 1' 2026-02-17T11:24:21.534 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:371: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T11:24:21.727 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:24:21.727 INFO:tasks.workunit.client.0.trial148.stdout:1.0 101 0 101 0 0 70420 0 0 18 84 18 active+undersized+degraded 2026-02-17T11:23:41.302414+0000 42'102 53:145 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T11:22:13.713825+0000 0'0 2026-02-17T11:22:13.713825+0000 0 0 periodic scrub scheduled @ 2026-02-18T19:17:24.720207+0000 0 0 2026-02-17T11:24:21.727 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:24:21.727 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:24:21.728 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:24:21.735 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:372: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.1 2026-02-17T11:24:21.736 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:24:21.736 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:24:21.737 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:24:21.737 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:24:21.737 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:24:21.844 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:24:21.844 INFO:tasks.workunit.client.0.trial148.stdout:reviving divergent 1 2026-02-17T11:24:21.844 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:374: TEST_divergent_ec: echo 'reviving divergent 1' 2026-02-17T11:24:21.844 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:375: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T11:24:22.032 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:24:22.033 INFO:tasks.workunit.client.0.trial148.stdout:1.0 101 0 101 0 0 70420 0 0 18 84 18 active+undersized+degraded 2026-02-17T11:23:41.302414+0000 42'102 53:145 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-17T11:22:13.713825+0000 0'0 2026-02-17T11:22:13.713825+0000 0 0 periodic scrub scheduled @ 2026-02-18T19:17:24.720207+0000 0 0 2026-02-17T11:24:22.033 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:24:22.033 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:24:22.033 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:24:22.044 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:376: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-17T11:24:22.044 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/divergent-priors 2026-02-17T11:24:22.044 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:24:22.045 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T11:24:22.045 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:24:22.045 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/divergent-priors/1 2026-02-17T11:24:22.045 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-17T11:24:22.045 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:24:22.045 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:24:22.045 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:24:22.045 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-17T11:24:22.045 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-17T11:24:22.045 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:24:22.045 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:24:22.045 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-17T11:24:22.046 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:24:22.046 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:24:22.046 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:24:22.046 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:24:22.046 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:24:22.046 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:24:22.046 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:24:22.046 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' 2026-02-17T11:24:22.046 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:24:22.046 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-17T11:24:22.046 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-17T11:24:22.046 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:24:22.046 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:24:22.047 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:24:22.047 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:24:22.047 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:24:22.047 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:24:22.047 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/divergent-priors/1 2026-02-17T11:24:22.047 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T11:24:22.048 INFO:tasks.workunit.client.0.trial148.stdout:start osd.1 2026-02-17T11:24:22.048 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=0bb6b7bd-e2e0-49a6-b4c4-59d8e983ff8a --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.19803/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:24:22.049 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/divergent-priors/1/whoami 2026-02-17T11:24:22.049 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T11:24:22.049 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:24:22.049 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:24:22.049 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:24:22.070 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:24:22.060+0000 7fe6aab678c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:24:22.072 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:24:22.064+0000 7fe6aab678c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:24:22.073 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:24:22.064+0000 7fe6aab678c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:24:22.255 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2026-02-17T11:24:22.255 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:24:22.255 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T11:24:22.255 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:24:22.255 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:24:22.255 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:24:22.255 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:24:22.255 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:24:22.255 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:24:22.256 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:24:22.457 INFO:tasks.workunit.client.0.trial148.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 31 last_clean_interval [10,29) [v2:127.0.0.1:6818/2972933085,v1:127.0.0.1:6819/2972933085] [v2:127.0.0.1:6820/2972933085,v1:127.0.0.1:6821/2972933085] exists,up 1b0c045e-9cdd-417f-946e-6a48f886c5a3 2026-02-17T11:24:22.458 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:24:22.458 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:24:22.458 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:24:22.458 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:378: TEST_divergent_ec: sleep 20 2026-02-17T11:24:23.334 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:24:23.324+0000 7fe6aab678c0 -1 Falling back to public interface 2026-02-17T11:24:26.316 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:24:26.308+0000 7fe6aab678c0 -1 osd.1 56 log_to_monitors true 2026-02-17T11:24:42.459 INFO:tasks.workunit.client.0.trial148.stdout:allowing recovery 2026-02-17T11:24:42.459 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:380: TEST_divergent_ec: echo 'allowing recovery' 2026-02-17T11:24:42.460 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:381: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T11:24:42.646 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:24:42.646 INFO:tasks.workunit.client.0.trial148.stdout:1.0 102 0 0 0 0 71115 0 0 13 90 13 active+clean 2026-02-17T11:24:26.658341+0000 56'103 60:157 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:22:13.713825+0000 0'0 2026-02-17T11:22:13.713825+0000 0 0 periodic scrub scheduled @ 2026-02-18T16:43:44.030043+0000 0 0 2026-02-17T11:24:42.646 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:24:42.646 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:24:42.646 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:24:42.654 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:383: TEST_divergent_ec: for i in $osds 2026-02-17T11:24:42.655 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:385: TEST_divergent_ec: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-17T11:24:42.738 INFO:tasks.workunit.client.0.trial148.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T11:24:42.745 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:383: TEST_divergent_ec: for i in $osds 2026-02-17T11:24:42.745 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:385: TEST_divergent_ec: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-17T11:24:42.823 INFO:tasks.workunit.client.0.trial148.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T11:24:42.830 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:383: TEST_divergent_ec: for i in $osds 2026-02-17T11:24:42.830 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:385: TEST_divergent_ec: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-17T11:24:42.906 INFO:tasks.workunit.client.0.trial148.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-17T11:24:42.913 INFO:tasks.workunit.client.0.trial148.stdout:reading divergent objects 2026-02-17T11:24:42.914 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:388: TEST_divergent_ec: echo 'reading divergent objects' 2026-02-17T11:24:42.914 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:389: TEST_divergent_ec: ceph pg dump pgs 2026-02-17T11:24:43.110 INFO:tasks.workunit.client.0.trial148.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-17T11:24:43.110 INFO:tasks.workunit.client.0.trial148.stdout:1.0 102 0 0 0 0 71115 0 0 13 90 13 active+clean 2026-02-17T11:24:26.658341+0000 56'103 60:157 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-17T11:22:13.713825+0000 0'0 2026-02-17T11:22:13.713825+0000 0 0 periodic scrub scheduled @ 2026-02-18T16:43:44.030043+0000 0 0 2026-02-17T11:24:43.110 INFO:tasks.workunit.client.0.trial148.stdout: 2026-02-17T11:24:43.110 INFO:tasks.workunit.client.0.trial148.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-17T11:24:43.111 INFO:tasks.workunit.client.0.trial148.stderr:dumped pgs 2026-02-17T11:24:43.119 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: expr 2 + 2 2026-02-17T11:24:43.120 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: seq 1 4 2026-02-17T11:24:43.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T11:24:43.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:392: TEST_divergent_ec: rados -p test get existing_1 td/divergent-priors/existing 2026-02-17T11:24:43.142 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T11:24:43.143 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:392: TEST_divergent_ec: rados -p test get existing_2 td/divergent-priors/existing 2026-02-17T11:24:43.171 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T11:24:43.171 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:392: TEST_divergent_ec: rados -p test get existing_3 td/divergent-priors/existing 2026-02-17T11:24:43.199 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-17T11:24:43.199 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:392: TEST_divergent_ec: rados -p test get existing_4 td/divergent-priors/existing 2026-02-17T11:24:43.226 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:394: TEST_divergent_ec: rm -f td/divergent-priors/existing 2026-02-17T11:24:43.228 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:396: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-17T11:24:43.229 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:396: TEST_divergent_ec: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T11:24:43.233 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:1 entries: 29'103 (28'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-17T11:22:30.321454+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false 2026-02-17T11:24:43.233 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 20 _merge_object_divergent_entries: keeping 29'103 (28'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-17T11:22:30.321454+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false 2026-02-17T11:24:43.233 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T11:24:43.233 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version: 28'99 first_divergent_update: 29'103 last_divergent_update: 29'103 2026-02-17T11:24:43.233 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 has no more recent entries in log 2026-02-17T11:24:43.233 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version or op type indicates creation, deleting 2026-02-17T11:24:43.233 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:head entries: 29'104 (28'99) modify 1:7a80c0d5:::existing_99:head by client.4587.0:1 2026-02-17T11:22:35.062664+0000 0 ObjectCleanRegions clean_offsets: [(695, 18446744073709550920)], clean_omap: true, new_object: false 2026-02-17T11:24:43.234 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 20 _merge_object_divergent_entries: keeping 29'104 (28'99) modify 1:7a80c0d5:::existing_99:head by client.4587.0:1 2026-02-17T11:22:35.062664+0000 0 ObjectCleanRegions clean_offsets: [(695, 18446744073709550920)], clean_omap: true, new_object: false 2026-02-17T11:24:43.234 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T11:24:43.234 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head prior_version: 28'99 first_divergent_update: 29'104 last_divergent_update: 29'104 2026-02-17T11:24:43.234 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head has no more recent entries in log 2026-02-17T11:24:43.234 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head must be rolled back or recovered, attempting to rollback 2026-02-17T11:24:43.234 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head olog_can_rollback_to: 29'104 2026-02-17T11:24:43.234 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot rollback 29'104 (28'99) modify 1:7a80c0d5:::existing_99:head by client.4587.0:1 2026-02-17T11:22:35.062664+0000 0 ObjectCleanRegions clean_offsets: [(695, 18446744073709550920)], clean_omap: true, new_object: false 2026-02-17T11:24:43.234 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot roll back, removing and adding to missing 2026-02-17T11:24:43.235 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 28'101 (28'100) modify 1:c156033e:::existing_100:head by client.4578.0:1 2026-02-17T11:22:33.993478+0000 0 ObjectCleanRegions clean_offsets: [(967, 18446744073709550648)], clean_omap: true, new_object: false,28'102 (28'101) modify 1:c156033e:::existing_100:head by client.4583.0:1 2026-02-17T11:22:34.988947+0000 0 ObjectCleanRegions clean_offsets: [(967, 18446744073709550648)], clean_omap: true, new_object: false 2026-02-17T11:24:43.235 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 20 _merge_object_divergent_entries: keeping 28'101 (28'100) modify 1:c156033e:::existing_100:head by client.4578.0:1 2026-02-17T11:22:33.993478+0000 0 ObjectCleanRegions clean_offsets: [(967, 18446744073709550648)], clean_omap: true, new_object: false 2026-02-17T11:24:43.235 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 20 _merge_object_divergent_entries: keeping 28'102 (28'101) modify 1:c156033e:::existing_100:head by client.4583.0:1 2026-02-17T11:22:34.988947+0000 0 ObjectCleanRegions clean_offsets: [(967, 18446744073709550648)], clean_omap: true, new_object: false 2026-02-17T11:24:43.235 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-17T11:24:43.235 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 28'100 first_divergent_update: 28'101 last_divergent_update: 28'102 2026-02-17T11:24:43.235 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-17T11:24:43.236 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-17T11:24:43.236 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 29'104 2026-02-17T11:24:43.236 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 28'102 (28'101) modify 1:c156033e:::existing_100:head by client.4583.0:1 2026-02-17T11:22:34.988947+0000 0 ObjectCleanRegions clean_offsets: [(967, 18446744073709550648)], clean_omap: true, new_object: false 2026-02-17T11:24:43.236 INFO:tasks.workunit.client.0.trial148.stdout:td/divergent-priors/osd.1.log:2026-02-17T11:24:21.112+0000 7fe208cfd640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-17T11:24:43.237 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:405: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-17T11:24:43.237 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:405: TEST_divergent_ec: grep -q '_merge_object_divergent_entries.*rolled back' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-17T11:24:43.242 INFO:tasks.workunit.client.0.trial148.stdout:success 2026-02-17T11:24:43.243 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:410: TEST_divergent_ec: echo success 2026-02-17T11:24:43.243 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:412: TEST_divergent_ec: delete_pool test 2026-02-17T11:24:43.244 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: delete_pool: local poolname=test 2026-02-17T11:24:43.244 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-17T11:24:43.487 INFO:tasks.workunit.client.0.trial148.stderr:pool 'test' does not exist 2026-02-17T11:24:43.496 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:413: TEST_divergent_ec: kill_daemons td/divergent-priors 2026-02-17T11:24:43.497 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:24:43.497 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:24:43.497 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:24:43.497 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:24:43.497 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:24:51.815 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:24:51.815 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-17T11:24:51.815 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/divergent-priors 2026-02-17T11:24:51.815 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T11:24:51.815 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T11:24:51.815 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:24:51.815 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:24:51.815 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:24:51.816 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:24:51.816 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:24:51.823 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:24:51.823 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:24:51.825 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:24:51.825 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:24:51.826 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:24:51.826 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:24:51.827 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:24:51.828 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:24:51.828 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:24:51.828 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:24:51.829 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:24:51.830 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:24:51.831 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T11:24:51.831 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/divergent-priors 2026-02-17T11:24:51.854 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:24:51.854 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:24:51.854 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:24:51.854 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.19803 2026-02-17T11:24:51.856 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T11:24:51.856 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T11:24:51.856 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: main: code=0 2026-02-17T11:24:51.856 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: main: teardown td/divergent-priors 0 2026-02-17T11:24:51.857 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/divergent-priors 2026-02-17T11:24:51.857 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2026-02-17T11:24:51.857 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/divergent-priors KILL 2026-02-17T11:24:51.857 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:24:51.857 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:24:51.858 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:24:51.858 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:24:51.858 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:24:51.859 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:24:51.860 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:24:51.861 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:24:51.861 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:24:51.862 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:24:51.863 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:24:51.863 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:24:51.864 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:24:51.864 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:24:51.865 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:24:51.865 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:24:51.866 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:24:51.867 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T11:24:51.867 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/divergent-priors 2026-02-17T11:24:51.868 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:24:51.868 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:24:51.868 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.19803 2026-02-17T11:24:51.868 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.19803 2026-02-17T11:24:51.869 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T11:24:51.869 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T11:24:51.870 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: main: return 0 2026-02-17T11:24:51.871 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T11:24:51.871 DEBUG:teuthology.orchestra.run.trial148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T11:24:51.920 INFO:tasks.workunit:Running workunit osd/ec-error-rollforward.sh... 2026-02-17T11:24:51.921 DEBUG:teuthology.orchestra.run.trial148:workunit test osd/ec-error-rollforward.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh 2026-02-17T11:24:51.973 INFO:tasks.workunit.client.0.trial148.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T11:24:51.978 INFO:tasks.workunit.client.0.trial148.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T11:24:51.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T11:24:51.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T11:24:51.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: export PYTHONWARNINGS=ignore 2026-02-17T11:24:51.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: PYTHONWARNINGS=ignore 2026-02-17T11:24:51.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: export CEPH_CONF=/dev/null 2026-02-17T11:24:51.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: CEPH_CONF=/dev/null 2026-02-17T11:24:51.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: main: unset CEPH_ARGS 2026-02-17T11:24:51.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: main: local code 2026-02-17T11:24:51.979 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: main: run td/ec-error-rollforward 2026-02-17T11:24:51.979 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:6: run: local dir=td/ec-error-rollforward 2026-02-17T11:24:51.979 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:7: run: shift 2026-02-17T11:24:51.979 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: export CEPH_MON=127.0.0.1:7132 2026-02-17T11:24:51.979 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: CEPH_MON=127.0.0.1:7132 2026-02-17T11:24:51.979 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:11: run: export CEPH_ARGS 2026-02-17T11:24:51.979 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: uuidgen 2026-02-17T11:24:51.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: CEPH_ARGS+='--fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none ' 2026-02-17T11:24:51.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:13: run: CEPH_ARGS+='--mon-host=127.0.0.1:7132 ' 2026-02-17T11:24:51.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: export margin=10 2026-02-17T11:24:51.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: margin=10 2026-02-17T11:24:51.981 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: export objects=200 2026-02-17T11:24:51.981 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: objects=200 2026-02-17T11:24:51.981 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: export poolname=test 2026-02-17T11:24:51.981 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: poolname=test 2026-02-17T11:24:51.981 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: set 2026-02-17T11:24:51.981 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T11:24:51.982 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: local funcs=TEST_ec_error_rollforward 2026-02-17T11:24:51.983 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:19: run: for func in $funcs 2026-02-17T11:24:51.983 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:20: run: setup td/ec-error-rollforward 2026-02-17T11:24:51.983 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/ec-error-rollforward 2026-02-17T11:24:51.983 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/ec-error-rollforward 2026-02-17T11:24:51.983 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ec-error-rollforward 2026-02-17T11:24:51.983 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T11:24:51.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-17T11:24:51.984 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:24:51.984 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:24:51.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:24:51.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:24:51.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:24:51.985 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:24:51.985 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:24:51.985 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:24:51.985 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:24:51.986 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:24:51.986 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:24:51.987 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:24:51.987 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:24:51.988 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:24:51.988 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:24:51.988 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:24:51.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:24:51.990 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T11:24:51.990 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ec-error-rollforward 2026-02-17T11:24:51.992 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:24:51.992 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:24:51.992 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.77326 2026-02-17T11:24:51.992 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.77326 2026-02-17T11:24:51.993 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T11:24:51.993 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T11:24:51.993 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/ec-error-rollforward 2026-02-17T11:24:51.995 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T11:24:51.995 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:24:51.995 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.77326 2026-02-17T11:24:51.995 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.77326 2026-02-17T11:24:51.996 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T11:24:51.998 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2026-02-17T11:24:51.998 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2026-02-17T11:24:51.998 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T11:24:51.998 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/ec-error-rollforward 1' TERM HUP INT 2026-02-17T11:24:51.999 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:21: run: TEST_ec_error_rollforward td/ec-error-rollforward 2026-02-17T11:24:51.999 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:27: TEST_ec_error_rollforward: local dir=td/ec-error-rollforward 2026-02-17T11:24:51.999 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:28: TEST_ec_error_rollforward: run_mon td/ec-error-rollforward a 2026-02-17T11:24:51.999 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/ec-error-rollforward 2026-02-17T11:24:51.999 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T11:24:51.999 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T11:24:52.000 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T11:24:52.000 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/ec-error-rollforward/a 2026-02-17T11:24:52.000 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/ec-error-rollforward/a --run-dir=td/ec-error-rollforward 2026-02-17T11:24:52.019 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T11:24:52.020 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:24:52.020 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:24:52.020 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:24:52.020 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:24:52.020 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.77326 2026-02-17T11:24:52.020 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.77326/$cluster-$name.asok' 2026-02-17T11:24:52.020 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ec-error-rollforward/a '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' --mon-cluster-log-file=td/ec-error-rollforward/log --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T11:24:52.045 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T11:24:52.046 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T11:24:52.046 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T11:24:52.046 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T11:24:52.046 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T11:24:52.046 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T11:24:52.047 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T11:24:52.047 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T11:24:52.047 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T11:24:52.047 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:24:52.047 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:24:52.047 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.77326 2026-02-17T11:24:52.047 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.77326/ceph-mon.a.asok 2026-02-17T11:24:52.047 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T11:24:52.048 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.77326/ceph-mon.a.asok config get fsid 2026-02-17T11:24:52.102 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T11:24:52.102 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T11:24:52.102 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T11:24:52.102 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T11:24:52.102 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T11:24:52.103 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T11:24:52.103 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T11:24:52.103 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T11:24:52.104 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:24:52.104 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:24:52.104 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.77326 2026-02-17T11:24:52.104 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.77326/ceph-mon.a.asok 2026-02-17T11:24:52.104 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T11:24:52.104 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.77326/ceph-mon.a.asok config get mon_host 2026-02-17T11:24:52.157 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:29: TEST_ec_error_rollforward: run_mgr td/ec-error-rollforward x 2026-02-17T11:24:52.157 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/ec-error-rollforward 2026-02-17T11:24:52.157 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T11:24:52.157 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T11:24:52.157 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T11:24:52.157 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/ec-error-rollforward/x 2026-02-17T11:24:52.158 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T11:24:52.265 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T11:24:52.265 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:24:52.265 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:24:52.265 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:24:52.265 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:24:52.266 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.77326 2026-02-17T11:24:52.266 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.77326/$cluster-$name.asok' 2026-02-17T11:24:52.266 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T11:24:52.267 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ec-error-rollforward/x '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T11:24:52.287 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:30: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 0 2026-02-17T11:24:52.287 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ec-error-rollforward 2026-02-17T11:24:52.287 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:24:52.287 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T11:24:52.287 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:24:52.287 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ec-error-rollforward/0 2026-02-17T11:24:52.287 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T11:24:52.287 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:24:52.288 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:24:52.288 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:24:52.288 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-17T11:24:52.288 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-17T11:24:52.288 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:24:52.288 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:24:52.288 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T11:24:52.288 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:24:52.288 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:24:52.288 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:24:52.288 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:24:52.288 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:24:52.288 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.77326 2026-02-17T11:24:52.289 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.77326/$cluster-$name.asok' 2026-02-17T11:24:52.289 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' 2026-02-17T11:24:52.289 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:24:52.289 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:24:52.289 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:24:52.289 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T11:24:52.289 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T11:24:52.289 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:24:52.289 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:24:52.289 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:24:52.289 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:24:52.289 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:24:52.290 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:24:52.290 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ec-error-rollforward/0 2026-02-17T11:24:52.290 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:24:52.290 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=6ff4984d-ceb3-4929-bce8-065b0d1aaf93 2026-02-17T11:24:52.290 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 6ff4984d-ceb3-4929-bce8-065b0d1aaf93' 2026-02-17T11:24:52.291 INFO:tasks.workunit.client.0.trial148.stdout:add osd0 6ff4984d-ceb3-4929-bce8-065b0d1aaf93 2026-02-17T11:24:52.291 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:24:52.299 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAEUJRp+WBnERAAo1r1OVA/3U8a/zTACNm8Ig== 2026-02-17T11:24:52.299 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAEUJRp+WBnERAAo1r1OVA/3U8a/zTACNm8Ig=="}' 2026-02-17T11:24:52.299 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 6ff4984d-ceb3-4929-bce8-065b0d1aaf93 -i td/ec-error-rollforward/0/new.json 2026-02-17T11:24:52.410 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:24:52.418 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ec-error-rollforward/0/new.json 2026-02-17T11:24:52.419 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAEUJRp+WBnERAAo1r1OVA/3U8a/zTACNm8Ig== --osd-uuid 6ff4984d-ceb3-4929-bce8-065b0d1aaf93 2026-02-17T11:24:52.435 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:24:52.423+0000 7f5a5d1698c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:24:52.437 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:24:52.427+0000 7f5a5d1698c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:24:52.438 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:24:52.427+0000 7f5a5d1698c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:24:52.438 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:24:52.427+0000 7f5a5d1698c0 -1 bdev(0x556eb4f97c00 td/ec-error-rollforward/0/block) open stat got: (1) Operation not permitted 2026-02-17T11:24:52.438 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:24:52.427+0000 7f5a5d1698c0 -1 bluestore(td/ec-error-rollforward/0) _read_fsid unparsable uuid 2026-02-17T11:24:55.065 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ec-error-rollforward/0/keyring 2026-02-17T11:24:55.066 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:24:55.066 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T11:24:55.067 INFO:tasks.workunit.client.0.trial148.stdout:adding osd0 key to auth repository 2026-02-17T11:24:55.067 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ec-error-rollforward/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:24:55.335 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T11:24:55.336 INFO:tasks.workunit.client.0.trial148.stdout:start osd.0 2026-02-17T11:24:55.336 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:24:55.336 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:24:55.336 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:24:55.336 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:24:55.358 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:24:55.347+0000 7fd1068258c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:24:55.360 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:24:55.347+0000 7fd1068258c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:24:55.361 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:24:55.351+0000 7fd1068258c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:24:55.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T11:24:55.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:24:55.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T11:24:55.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:24:55.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:24:55.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:24:55.540 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:24:55.540 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:24:55.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:24:55.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:24:55.743 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:24:56.745 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:24:56.745 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:24:56.745 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:24:56.745 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:24:56.745 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:24:56.745 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:24:56.938 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:24:57.082 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:24:57.071+0000 7fd1068258c0 -1 Falling back to public interface 2026-02-17T11:24:57.939 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:24:57.940 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:24:57.940 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:24:57.941 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:24:57.941 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:24:57.941 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:24:58.133 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:24:59.134 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:24:59.134 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:24:59.134 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:24:59.134 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:24:59.134 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:24:59.134 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:24:59.330 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:00.082 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:00.071+0000 7fd1068258c0 -1 osd.0 0 log_to_monitors true 2026-02-17T11:25:00.331 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:00.331 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:00.331 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:25:00.331 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:25:00.331 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:00.331 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:25:00.523 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:01.525 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:01.525 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:01.525 INFO:tasks.workunit.client.0.trial148.stdout:5 2026-02-17T11:25:01.526 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T11:25:01.526 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:01.526 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:25:01.720 INFO:tasks.workunit.client.0.trial148.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2155267525,v1:127.0.0.1:6803/2155267525] [v2:127.0.0.1:6804/2155267525,v1:127.0.0.1:6805/2155267525] exists,up 6ff4984d-ceb3-4929-bce8-065b0d1aaf93 2026-02-17T11:25:01.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:25:01.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:25:01.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:25:01.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:31: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 1 2026-02-17T11:25:01.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ec-error-rollforward 2026-02-17T11:25:01.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:25:01.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T11:25:01.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:25:01.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ec-error-rollforward/1 2026-02-17T11:25:01.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T11:25:01.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:25:01.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:25:01.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:25:01.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-17T11:25:01.721 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-17T11:25:01.722 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:25:01.722 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:25:01.722 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T11:25:01.722 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:25:01.722 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:25:01.722 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:25:01.722 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:25:01.722 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:01.722 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.77326 2026-02-17T11:25:01.722 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.77326/$cluster-$name.asok' 2026-02-17T11:25:01.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' 2026-02-17T11:25:01.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:25:01.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:25:01.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:25:01.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T11:25:01.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T11:25:01.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:25:01.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:25:01.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:25:01.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:25:01.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:25:01.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:25:01.723 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ec-error-rollforward/1 2026-02-17T11:25:01.724 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:25:01.725 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=fc32ff3f-cb9e-4251-b7e4-27e1e1a756ba 2026-02-17T11:25:01.725 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 fc32ff3f-cb9e-4251-b7e4-27e1e1a756ba' 2026-02-17T11:25:01.725 INFO:tasks.workunit.client.0.trial148.stdout:add osd1 fc32ff3f-cb9e-4251-b7e4-27e1e1a756ba 2026-02-17T11:25:01.726 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:25:01.738 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQANUJRpeuiPKxAA8jVPF2hv2urjZ2f41SZCCw== 2026-02-17T11:25:01.738 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQANUJRpeuiPKxAA8jVPF2hv2urjZ2f41SZCCw=="}' 2026-02-17T11:25:01.738 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new fc32ff3f-cb9e-4251-b7e4-27e1e1a756ba -i td/ec-error-rollforward/1/new.json 2026-02-17T11:25:01.945 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:25:01.953 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ec-error-rollforward/1/new.json 2026-02-17T11:25:01.954 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQANUJRpeuiPKxAA8jVPF2hv2urjZ2f41SZCCw== --osd-uuid fc32ff3f-cb9e-4251-b7e4-27e1e1a756ba 2026-02-17T11:25:01.969 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:01.959+0000 7f729ebae8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:01.971 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:01.959+0000 7f729ebae8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:01.971 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:01.959+0000 7f729ebae8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:01.972 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:01.959+0000 7f729ebae8c0 -1 bdev(0x55faac1adc00 td/ec-error-rollforward/1/block) open stat got: (1) Operation not permitted 2026-02-17T11:25:01.972 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:01.959+0000 7f729ebae8c0 -1 bluestore(td/ec-error-rollforward/1) _read_fsid unparsable uuid 2026-02-17T11:25:04.260 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ec-error-rollforward/1/keyring 2026-02-17T11:25:04.260 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:25:04.261 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T11:25:04.261 INFO:tasks.workunit.client.0.trial148.stdout:adding osd1 key to auth repository 2026-02-17T11:25:04.262 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ec-error-rollforward/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:25:04.526 INFO:tasks.workunit.client.0.trial148.stdout:start osd.1 2026-02-17T11:25:04.527 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T11:25:04.527 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:25:04.527 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:25:04.527 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:25:04.527 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:25:04.547 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:04.535+0000 7f8f36c588c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:04.549 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:04.539+0000 7f8f36c588c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:04.550 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:04.539+0000 7f8f36c588c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:04.739 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T11:25:04.739 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:25:04.740 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T11:25:04.740 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:25:04.740 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:25:04.740 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:04.741 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:25:04.741 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:25:04.742 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:04.742 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:25:04.939 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:05.940 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:05.940 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:05.940 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:25:05.940 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:25:05.940 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:05.940 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:25:06.058 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:06.047+0000 7f8f36c588c0 -1 Falling back to public interface 2026-02-17T11:25:06.138 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:07.139 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:07.139 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:07.139 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:25:07.140 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:25:07.140 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:07.140 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:25:07.330 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:08.331 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:08.331 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:08.332 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:25:08.332 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:25:08.332 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:08.333 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:25:08.523 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:09.057 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:09.043+0000 7f8f36c588c0 -1 osd.1 0 log_to_monitors true 2026-02-17T11:25:09.525 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:09.526 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:09.526 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:25:09.526 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:25:09.527 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:09.528 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:25:09.729 INFO:tasks.workunit.client.0.trial148.stdout:osd.1 up in weight 1 up_from 10 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2010357453,v1:127.0.0.1:6811/2010357453] [v2:127.0.0.1:6812/2010357453,v1:127.0.0.1:6813/2010357453] exists,up fc32ff3f-cb9e-4251-b7e4-27e1e1a756ba 2026-02-17T11:25:09.731 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:25:09.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:25:09.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:25:09.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:32: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 2 2026-02-17T11:25:09.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ec-error-rollforward 2026-02-17T11:25:09.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:25:09.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T11:25:09.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:25:09.732 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ec-error-rollforward/2 2026-02-17T11:25:09.733 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T11:25:09.733 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:25:09.733 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:25:09.733 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:25:09.733 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-17T11:25:09.733 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-17T11:25:09.733 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:25:09.733 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:25:09.733 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T11:25:09.733 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:25:09.733 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:25:09.734 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:25:09.734 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:25:09.734 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:09.734 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.77326 2026-02-17T11:25:09.734 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.77326/$cluster-$name.asok' 2026-02-17T11:25:09.734 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' 2026-02-17T11:25:09.734 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:25:09.734 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:25:09.734 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:25:09.734 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T11:25:09.734 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T11:25:09.735 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:25:09.735 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:25:09.735 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:25:09.735 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:25:09.735 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:25:09.735 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:25:09.735 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ec-error-rollforward/2 2026-02-17T11:25:09.736 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:25:09.736 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=daddd449-3301-4b0d-8155-9707f728df01 2026-02-17T11:25:09.736 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 daddd449-3301-4b0d-8155-9707f728df01' 2026-02-17T11:25:09.737 INFO:tasks.workunit.client.0.trial148.stdout:add osd2 daddd449-3301-4b0d-8155-9707f728df01 2026-02-17T11:25:09.737 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:25:09.745 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAVUJRphiEELBAAB2TpK8zIj8YQztco76czuw== 2026-02-17T11:25:09.745 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAVUJRphiEELBAAB2TpK8zIj8YQztco76czuw=="}' 2026-02-17T11:25:09.746 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new daddd449-3301-4b0d-8155-9707f728df01 -i td/ec-error-rollforward/2/new.json 2026-02-17T11:25:09.951 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:25:09.959 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ec-error-rollforward/2/new.json 2026-02-17T11:25:09.960 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAVUJRphiEELBAAB2TpK8zIj8YQztco76czuw== --osd-uuid daddd449-3301-4b0d-8155-9707f728df01 2026-02-17T11:25:09.975 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:09.963+0000 7f252e43e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:09.977 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:09.967+0000 7f252e43e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:09.978 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:09.967+0000 7f252e43e8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:09.979 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:09.967+0000 7f252e43e8c0 -1 bdev(0x55d58c8b9c00 td/ec-error-rollforward/2/block) open stat got: (1) Operation not permitted 2026-02-17T11:25:09.979 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:09.967+0000 7f252e43e8c0 -1 bluestore(td/ec-error-rollforward/2) _read_fsid unparsable uuid 2026-02-17T11:25:12.270 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ec-error-rollforward/2/keyring 2026-02-17T11:25:12.270 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:25:12.271 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T11:25:12.271 INFO:tasks.workunit.client.0.trial148.stdout:adding osd2 key to auth repository 2026-02-17T11:25:12.271 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ec-error-rollforward/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:25:12.539 INFO:tasks.workunit.client.0.trial148.stdout:start osd.2 2026-02-17T11:25:12.540 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T11:25:12.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:25:12.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:25:12.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:25:12.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:25:12.560 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:12.547+0000 7fe16d8458c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:12.561 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:12.551+0000 7fe16d8458c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:12.562 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:12.551+0000 7fe16d8458c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:12.741 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T11:25:12.741 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:25:12.742 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T11:25:12.742 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:25:12.742 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:25:12.742 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:12.742 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:25:12.743 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:25:12.743 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:12.743 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:25:12.938 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:13.940 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:13.940 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:13.940 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:25:13.941 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:25:13.941 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:13.941 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:25:14.074 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:14.063+0000 7fe16d8458c0 -1 Falling back to public interface 2026-02-17T11:25:14.133 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:15.135 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:15.135 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:15.136 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:25:15.136 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:25:15.136 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:15.137 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:25:15.332 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:16.333 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:16.333 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:16.333 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:25:16.334 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:25:16.334 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:16.334 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:25:16.527 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:17.352 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:17.339+0000 7fe16d8458c0 -1 osd.2 0 log_to_monitors true 2026-02-17T11:25:17.528 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:17.529 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:17.529 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:25:17.530 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:25:17.530 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:17.530 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:25:17.722 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:18.724 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:18.724 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:18.724 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T11:25:18.724 INFO:tasks.workunit.client.0.trial148.stdout:5 2026-02-17T11:25:18.725 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:18.725 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:25:18.917 INFO:tasks.workunit.client.0.trial148.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2107862437,v1:127.0.0.1:6819/2107862437] [v2:127.0.0.1:6820/2107862437,v1:127.0.0.1:6821/2107862437] exists,up daddd449-3301-4b0d-8155-9707f728df01 2026-02-17T11:25:18.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:25:18.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:25:18.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:25:18.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:33: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 3 2026-02-17T11:25:18.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/ec-error-rollforward 2026-02-17T11:25:18.920 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:25:18.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2026-02-17T11:25:18.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:25:18.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/ec-error-rollforward/3 2026-02-17T11:25:18.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T11:25:18.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:25:18.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:25:18.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:25:18.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-17T11:25:18.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-17T11:25:18.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:25:18.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:25:18.921 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T11:25:18.922 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:25:18.922 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:25:18.922 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:25:18.922 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:25:18.922 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:18.922 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.77326 2026-02-17T11:25:18.922 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.77326/$cluster-$name.asok' 2026-02-17T11:25:18.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' 2026-02-17T11:25:18.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:25:18.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:25:18.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:25:18.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T11:25:18.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T11:25:18.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:25:18.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:25:18.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:25:18.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:25:18.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:25:18.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:25:18.923 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/ec-error-rollforward/3 2026-02-17T11:25:18.924 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:25:18.924 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=546a61bd-128c-4746-86e6-f2c639858787 2026-02-17T11:25:18.924 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 546a61bd-128c-4746-86e6-f2c639858787' 2026-02-17T11:25:18.924 INFO:tasks.workunit.client.0.trial148.stdout:add osd3 546a61bd-128c-4746-86e6-f2c639858787 2026-02-17T11:25:18.925 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:25:18.935 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQAeUJRpjDJCNxAAsoVZvd9hSX/iS/ySVHaKEQ== 2026-02-17T11:25:18.935 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQAeUJRpjDJCNxAAsoVZvd9hSX/iS/ySVHaKEQ=="}' 2026-02-17T11:25:18.935 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 546a61bd-128c-4746-86e6-f2c639858787 -i td/ec-error-rollforward/3/new.json 2026-02-17T11:25:19.135 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:25:19.144 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/ec-error-rollforward/3/new.json 2026-02-17T11:25:19.145 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQAeUJRpjDJCNxAAsoVZvd9hSX/iS/ySVHaKEQ== --osd-uuid 546a61bd-128c-4746-86e6-f2c639858787 2026-02-17T11:25:19.160 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:19.147+0000 7fc5cb7888c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:19.161 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:19.151+0000 7fc5cb7888c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:19.162 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:19.151+0000 7fc5cb7888c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:19.163 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:19.151+0000 7fc5cb7888c0 -1 bdev(0x557b830f1c00 td/ec-error-rollforward/3/block) open stat got: (1) Operation not permitted 2026-02-17T11:25:19.163 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:19.151+0000 7fc5cb7888c0 -1 bluestore(td/ec-error-rollforward/3) _read_fsid unparsable uuid 2026-02-17T11:25:21.442 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/ec-error-rollforward/3/keyring 2026-02-17T11:25:21.442 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:25:21.443 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2026-02-17T11:25:21.443 INFO:tasks.workunit.client.0.trial148.stdout:adding osd3 key to auth repository 2026-02-17T11:25:21.443 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/ec-error-rollforward/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:25:21.705 INFO:tasks.workunit.client.0.trial148.stdout:start osd.3 2026-02-17T11:25:21.706 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2026-02-17T11:25:21.706 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:25:21.706 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:25:21.707 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:25:21.707 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:25:21.725 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:21.715+0000 7f63552a08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:21.727 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:21.715+0000 7f63552a08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:21.728 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:21.715+0000 7f63552a08c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:21.912 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2026-02-17T11:25:21.912 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:25:21.912 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T11:25:21.912 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:25:21.912 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:25:21.912 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:21.913 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:25:21.913 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:25:21.913 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:21.913 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T11:25:22.103 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:23.104 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:23.104 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:23.104 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:25:23.104 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:25:23.104 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:23.104 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T11:25:23.255 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:23.243+0000 7f63552a08c0 -1 Falling back to public interface 2026-02-17T11:25:23.300 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:24.301 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:24.301 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:24.301 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:25:24.301 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:25:24.302 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:24.302 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T11:25:24.501 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:25.502 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:25.502 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:25.503 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:25:25.503 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:25:25.504 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:25.504 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T11:25:25.698 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:26.269 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:26.259+0000 7f63552a08c0 -1 osd.3 0 log_to_monitors true 2026-02-17T11:25:26.699 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:26.699 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:26.699 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:25:26.700 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:25:26.700 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:26.700 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T11:25:26.902 INFO:tasks.workunit.client.0.trial148.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2987427673,v1:127.0.0.1:6827/2987427673] [v2:127.0.0.1:6828/2987427673,v1:127.0.0.1:6829/2987427673] exists,up 546a61bd-128c-4746-86e6-f2c639858787 2026-02-17T11:25:26.903 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:25:26.903 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:25:26.903 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:25:26.903 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:35: TEST_ec_error_rollforward: ceph osd erasure-code-profile set ec-profile m=2 k=2 crush-failure-domain=osd 2026-02-17T11:25:27.107 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:36: TEST_ec_error_rollforward: ceph osd pool create ec 1 1 erasure ec-profile 2026-02-17T11:25:27.462 INFO:tasks.workunit.client.0.trial148.stderr:pool 'ec' already exists 2026-02-17T11:25:27.470 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:38: TEST_ec_error_rollforward: rados -p ec put foo /etc/passwd 2026-02-17T11:25:27.868 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: cat td/ec-error-rollforward/osd.2.pid 2026-02-17T11:25:27.869 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: kill -STOP 82914 2026-02-17T11:25:27.869 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:43: TEST_ec_error_rollforward: pids=85506 2026-02-17T11:25:27.870 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:44: TEST_ec_error_rollforward: sleep 1 2026-02-17T11:25:27.870 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:42: TEST_ec_error_rollforward: rados -p ec rm foo 2026-02-17T11:25:28.870 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:46: TEST_ec_error_rollforward: pids+=' 85527' 2026-02-17T11:25:28.870 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:45: TEST_ec_error_rollforward: rados -p ec rm a 2026-02-17T11:25:28.870 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:48: TEST_ec_error_rollforward: pids+=' 85528' 2026-02-17T11:25:28.870 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:47: TEST_ec_error_rollforward: rados -p ec rm b 2026-02-17T11:25:28.870 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:50: TEST_ec_error_rollforward: pids+=' 85529' 2026-02-17T11:25:28.870 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:51: TEST_ec_error_rollforward: sleep 1 2026-02-17T11:25:28.870 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:49: TEST_ec_error_rollforward: rados -p ec rm c 2026-02-17T11:25:29.872 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:54: TEST_ec_error_rollforward: kill_daemons td/ec-error-rollforward KILL osd 2026-02-17T11:25:29.873 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:25:29.873 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:25:29.873 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:25:29.873 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:25:29.873 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:25:29.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:25:29.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:55: TEST_ec_error_rollforward: kill 85506 85527 85528 85529 2026-02-17T11:25:29.984 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:56: TEST_ec_error_rollforward: wait 2026-02-17T11:25:29.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:58: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 0 2026-02-17T11:25:29.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/ec-error-rollforward 2026-02-17T11:25:29.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:25:29.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=0 2026-02-17T11:25:29.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:25:29.989 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/ec-error-rollforward/0 2026-02-17T11:25:29.990 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T11:25:29.990 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:25:29.990 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:25:29.990 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:25:29.990 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-17T11:25:29.990 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-17T11:25:29.990 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:25:29.990 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:25:29.990 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T11:25:29.990 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:25:29.990 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:25:29.990 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:25:29.991 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:25:29.991 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:29.991 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.77326 2026-02-17T11:25:29.991 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.77326/$cluster-$name.asok' 2026-02-17T11:25:29.991 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' 2026-02-17T11:25:29.991 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:25:29.991 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T11:25:29.991 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T11:25:29.991 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:25:29.991 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:25:29.991 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:25:29.991 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:25:29.991 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:25:29.992 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:25:29.992 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/ec-error-rollforward/0 2026-02-17T11:25:29.992 INFO:tasks.workunit.client.0.trial148.stdout:start osd.0 2026-02-17T11:25:29.993 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.0 2026-02-17T11:25:29.993 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 0 --fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:25:29.993 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/ec-error-rollforward/0/whoami 2026-02-17T11:25:29.993 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 0 = 0 ']' 2026-02-17T11:25:29.994 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:25:29.994 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:25:29.994 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:25:30.005 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:29.995+0000 7f519ec138c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:30.007 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:29.995+0000 7f519ec138c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:30.008 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:29.995+0000 7f519ec138c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:30.192 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 0 2026-02-17T11:25:30.192 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:25:30.193 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T11:25:30.193 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:25:30.193 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:25:30.193 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:30.193 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:25:30.193 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:25:30.193 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:30.193 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:25:30.393 INFO:tasks.workunit.client.0.trial148.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/2155267525,v1:127.0.0.1:6803/2155267525] [v2:127.0.0.1:6804/2155267525,v1:127.0.0.1:6805/2155267525] exists,up 6ff4984d-ceb3-4929-bce8-065b0d1aaf93 2026-02-17T11:25:30.396 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:25:30.396 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:25:30.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:25:30.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:59: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 1 2026-02-17T11:25:30.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/ec-error-rollforward 2026-02-17T11:25:30.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:25:30.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=1 2026-02-17T11:25:30.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:25:30.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/ec-error-rollforward/1 2026-02-17T11:25:30.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T11:25:30.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:25:30.398 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:25:30.398 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:25:30.398 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-17T11:25:30.398 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-17T11:25:30.398 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:25:30.398 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:25:30.398 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T11:25:30.398 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:25:30.398 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:25:30.398 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:25:30.398 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:25:30.399 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:30.399 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.77326 2026-02-17T11:25:30.399 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.77326/$cluster-$name.asok' 2026-02-17T11:25:30.399 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' 2026-02-17T11:25:30.399 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:25:30.399 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T11:25:30.399 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T11:25:30.399 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:25:30.399 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:25:30.399 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:25:30.399 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:25:30.400 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:25:30.400 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:25:30.400 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/ec-error-rollforward/1 2026-02-17T11:25:30.400 INFO:tasks.workunit.client.0.trial148.stdout:start osd.1 2026-02-17T11:25:30.401 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.1 2026-02-17T11:25:30.401 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 1 --fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:25:30.402 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/ec-error-rollforward/1/whoami 2026-02-17T11:25:30.402 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 1 = 1 ']' 2026-02-17T11:25:30.402 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:25:30.402 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:25:30.402 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:25:30.412 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:30.399+0000 7f6d3daef8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:30.414 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:30.403+0000 7f6d3daef8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:30.415 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:30.403+0000 7f6d3daef8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:30.595 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 1 2026-02-17T11:25:30.596 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:25:30.596 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T11:25:30.596 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:25:30.596 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:25:30.596 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:30.597 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:25:30.597 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:25:30.597 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:30.597 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:25:30.790 INFO:tasks.workunit.client.0.trial148.stdout:osd.1 up in weight 1 up_from 10 up_thru 22 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/2010357453,v1:127.0.0.1:6811/2010357453] [v2:127.0.0.1:6812/2010357453,v1:127.0.0.1:6813/2010357453] exists,up fc32ff3f-cb9e-4251-b7e4-27e1e1a756ba 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:60: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 2 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/ec-error-rollforward 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=2 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/ec-error-rollforward/2 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:25:30.791 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:25:30.792 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:25:30.792 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:30.792 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.77326 2026-02-17T11:25:30.792 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.77326/$cluster-$name.asok' 2026-02-17T11:25:30.792 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' 2026-02-17T11:25:30.792 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:25:30.792 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T11:25:30.792 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T11:25:30.792 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:25:30.792 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:25:30.792 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:25:30.792 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:25:30.792 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:25:30.792 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:25:30.792 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/ec-error-rollforward/2 2026-02-17T11:25:30.793 INFO:tasks.workunit.client.0.trial148.stdout:start osd.2 2026-02-17T11:25:30.793 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.2 2026-02-17T11:25:30.793 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 2 --fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:25:30.793 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/ec-error-rollforward/2/whoami 2026-02-17T11:25:30.794 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 2 = 2 ']' 2026-02-17T11:25:30.794 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:25:30.794 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:25:30.795 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:25:30.811 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:30.799+0000 7f30e07408c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:30.812 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:30.799+0000 7f30e07408c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:30.814 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:30.803+0000 7f30e07408c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:30.996 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 2 2026-02-17T11:25:30.997 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:25:30.997 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T11:25:30.997 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:25:30.997 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:25:30.997 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:30.998 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:25:30.998 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:25:30.998 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:30.998 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:25:31.194 INFO:tasks.workunit.client.0.trial148.stdout:osd.2 up in weight 1 up_from 15 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2107862437,v1:127.0.0.1:6819/2107862437] [v2:127.0.0.1:6820/2107862437,v1:127.0.0.1:6821/2107862437] exists,up daddd449-3301-4b0d-8155-9707f728df01 2026-02-17T11:25:31.198 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:25:31.198 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:25:31.198 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:25:31.198 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:61: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 3 2026-02-17T11:25:31.198 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: local dir=td/ec-error-rollforward 2026-02-17T11:25:31.198 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: shift 2026-02-17T11:25:31.198 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: local id=3 2026-02-17T11:25:31.199 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: shift 2026-02-17T11:25:31.199 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: local osd_data=td/ec-error-rollforward/3 2026-02-17T11:25:31.199 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: local 'ceph_args=--fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-17T11:25:31.199 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:25:31.199 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:25:31.199 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:25:31.199 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-17T11:25:31.199 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-17T11:25:31.199 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --chdir=' 2026-02-17T11:25:31.199 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+= 2026-02-17T11:25:31.200 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-17T11:25:31.200 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: get_asok_path 2026-02-17T11:25:31.200 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:25:31.200 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:25:31.200 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:25:31.200 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:31.200 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.77326 2026-02-17T11:25:31.200 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.77326/$cluster-$name.asok' 2026-02-17T11:25:31.200 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' 2026-02-17T11:25:31.201 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:25:31.201 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:863: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-17T11:25:31.201 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-17T11:25:31.201 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:25:31.201 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:866: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:25:31.201 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:25:31.201 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:868: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:25:31.201 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:869: activate_osd: ceph_args+=' ' 2026-02-17T11:25:31.201 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph_args+= 2026-02-17T11:25:31.201 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: mkdir -p td/ec-error-rollforward/3 2026-02-17T11:25:31.202 INFO:tasks.workunit.client.0.trial148.stdout:start osd.3 2026-02-17T11:25:31.203 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: echo start osd.3 2026-02-17T11:25:31.203 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:874: activate_osd: ceph-osd -i 3 --fsid=43852b9a-2257-4e2b-ba11-0e21d001fc60 --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.77326/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:25:31.203 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: cat td/ec-error-rollforward/3/whoami 2026-02-17T11:25:31.204 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:876: activate_osd: '[' 3 = 3 ']' 2026-02-17T11:25:31.204 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: ceph osd dump --format=json 2026-02-17T11:25:31.204 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: jq '.flags_set[]' 2026-02-17T11:25:31.204 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:879: activate_osd: grep -q '"noup"' 2026-02-17T11:25:31.213 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:31.199+0000 7f6210ab88c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:31.214 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:31.203+0000 7f6210ab88c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:31.215 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:31.203+0000 7f6210ab88c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:31.401 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:882: activate_osd: wait_for_osd up 3 2026-02-17T11:25:31.401 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:25:31.402 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T11:25:31.402 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:25:31.402 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:25:31.402 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:31.402 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:25:31.403 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:25:31.403 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:31.403 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T11:25:31.600 INFO:tasks.workunit.client.0.trial148.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2987427673,v1:127.0.0.1:6827/2987427673] [v2:127.0.0.1:6828/2987427673,v1:127.0.0.1:6829/2987427673] exists,up 546a61bd-128c-4746-86e6-f2c639858787 2026-02-17T11:25:31.601 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:25:31.602 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:25:31.602 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:25:31.602 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:63: TEST_ec_error_rollforward: wait_for_clean 2026-02-17T11:25:31.602 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1656: wait_for_clean: local cmd= 2026-02-17T11:25:31.602 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1657: wait_for_clean: local num_active_clean=-1 2026-02-17T11:25:31.602 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: local cur_active_clean 2026-02-17T11:25:31.602 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: get_timeout_delays 90 .1 2026-02-17T11:25:31.602 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: shopt -q -o xtrace 2026-02-17T11:25:31.602 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: echo true 2026-02-17T11:25:31.602 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1602: get_timeout_delays: local trace=true 2026-02-17T11:25:31.603 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: true 2026-02-17T11:25:31.603 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1603: get_timeout_delays: shopt -u -o xtrace 2026-02-17T11:25:31.683 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-17T11:25:31.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1659: wait_for_clean: local -a delays 2026-02-17T11:25:31.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1660: wait_for_clean: local -i loop=0 2026-02-17T11:25:31.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: flush_pg_stats 2026-02-17T11:25:31.684 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2260: flush_pg_stats: local timeout=300 2026-02-17T11:25:31.684 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ceph osd ls 2026-02-17T11:25:31.750 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:31.739+0000 7f6d3daef8c0 -1 Falling back to public interface 2026-02-17T11:25:31.822 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:31.811+0000 7f519ec138c0 -1 Falling back to public interface 2026-02-17T11:25:31.887 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2262: flush_pg_stats: ids='0 2026-02-17T11:25:31.887 INFO:tasks.workunit.client.0.trial148.stderr:1 2026-02-17T11:25:31.887 INFO:tasks.workunit.client.0.trial148.stderr:2 2026-02-17T11:25:31.887 INFO:tasks.workunit.client.0.trial148.stderr:3' 2026-02-17T11:25:31.888 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs= 2026-02-17T11:25:31.888 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:25:31.888 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-17T11:25:32.126 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:32.115+0000 7f30e07408c0 -1 Falling back to public interface 2026-02-17T11:25:32.759 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:32.747+0000 7f6210ab88c0 -1 Falling back to public interface 2026-02-17T11:25:34.769 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:34.755+0000 7f6d3daef8c0 -1 osd.1 24 log_to_monitors true 2026-02-17T11:25:34.916 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:34.903+0000 7f519ec138c0 -1 osd.0 24 log_to_monitors true 2026-02-17T11:25:35.286 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:35.275+0000 7f30e07408c0 -1 osd.2 23 log_to_monitors true 2026-02-17T11:25:35.908 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:35.895+0000 7f6210ab88c0 -1 osd.3 24 log_to_monitors true 2026-02-17T11:25:36.974 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=120259084291 2026-02-17T11:25:36.974 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 120259084291 2026-02-17T11:25:36.974 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-120259084291' 2026-02-17T11:25:36.974 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:25:36.974 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-17T11:25:37.046 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=115964116995 2026-02-17T11:25:37.046 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 115964116995 2026-02-17T11:25:37.046 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-120259084291 1-115964116995' 2026-02-17T11:25:37.047 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:25:37.047 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-17T11:25:37.123 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=137438953475 2026-02-17T11:25:37.123 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 137438953475 2026-02-17T11:25:37.123 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-120259084291 1-115964116995 2-137438953475' 2026-02-17T11:25:37.123 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2264: flush_pg_stats: for osd in $ids 2026-02-17T11:25:37.123 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-17T11:25:37.202 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2265: flush_pg_stats: seq=154618822659 2026-02-17T11:25:37.202 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: test -z 154618822659 2026-02-17T11:25:37.202 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: seqs=' 0-120259084291 1-115964116995 2-137438953475 3-154618822659' 2026-02-17T11:25:37.202 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:25:37.202 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 0-120259084291 2026-02-17T11:25:37.203 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:25:37.204 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=0 2026-02-17T11:25:37.205 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 0-120259084291 2026-02-17T11:25:37.205 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:25:37.206 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=120259084291 2026-02-17T11:25:37.206 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.0 seq 120259084291 2026-02-17T11:25:37.206 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.0 seq 120259084291' 2026-02-17T11:25:37.207 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:25:37.410 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 1 -lt 120259084291 2026-02-17T11:25:37.410 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2278: flush_pg_stats: sleep 1 2026-02-17T11:25:38.411 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2279: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-17T11:25:38.412 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-17T11:25:38.616 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 120259084291 -lt 120259084291 2026-02-17T11:25:38.616 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:25:38.617 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 1-115964116995 2026-02-17T11:25:38.617 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:25:38.618 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=1 2026-02-17T11:25:38.618 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 1-115964116995 2026-02-17T11:25:38.619 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:25:38.620 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=115964116995 2026-02-17T11:25:38.620 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.1 seq 115964116995 2026-02-17T11:25:38.621 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.1 seq 115964116995' 2026-02-17T11:25:38.621 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-17T11:25:38.822 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 115964116995 -lt 115964116995 2026-02-17T11:25:38.822 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:25:38.823 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 2-137438953475 2026-02-17T11:25:38.823 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:25:38.824 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=2 2026-02-17T11:25:38.825 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 2-137438953475 2026-02-17T11:25:38.825 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:25:38.827 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=137438953475 2026-02-17T11:25:38.827 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.2 seq 137438953475' 2026-02-17T11:25:38.827 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.2 seq 137438953475 2026-02-17T11:25:38.828 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-17T11:25:39.040 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 137438953475 -lt 137438953475 2026-02-17T11:25:39.040 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2273: flush_pg_stats: for s in $seqs 2026-02-17T11:25:39.041 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: echo 3-154618822659 2026-02-17T11:25:39.041 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: cut -d - -f 1 2026-02-17T11:25:39.042 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2274: flush_pg_stats: osd=3 2026-02-17T11:25:39.043 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: echo 3-154618822659 2026-02-17T11:25:39.043 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: cut -d - -f 2 2026-02-17T11:25:39.044 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2275: flush_pg_stats: seq=154618822659 2026-02-17T11:25:39.044 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2276: flush_pg_stats: echo 'waiting osd.3 seq 154618822659' 2026-02-17T11:25:39.045 INFO:tasks.workunit.client.0.trial148.stdout:waiting osd.3 seq 154618822659 2026-02-17T11:25:39.045 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-17T11:25:39.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2277: flush_pg_stats: test 154618822659 -lt 154618822659 2026-02-17T11:25:39.253 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-17T11:25:39.253 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:25:39.253 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:25:39.509 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 == 0 2026-02-17T11:25:39.509 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: true 2026-02-17T11:25:39.510 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: get_num_active_clean 2026-02-17T11:25:39.510 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1364: get_num_active_clean: local expression 2026-02-17T11:25:39.510 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1365: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-17T11:25:39.510 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1366: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-17T11:25:39.510 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1367: get_num_active_clean: ceph --format json pg dump pgs 2026-02-17T11:25:39.510 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1368: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-17T11:25:39.702 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: cur_active_clean=1 2026-02-17T11:25:39.702 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: get_num_pgs 2026-02-17T11:25:39.703 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: ceph --format json status 2026-02-17T11:25:39.703 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1425: get_num_pgs: jq .pgmap.num_pgs 2026-02-17T11:25:39.954 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: test 1 = 1 2026-02-17T11:25:39.954 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1672: wait_for_clean: break 2026-02-17T11:25:39.954 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1687: wait_for_clean: return 0 2026-02-17T11:25:39.954 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:22: run: teardown td/ec-error-rollforward 2026-02-17T11:25:39.954 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ec-error-rollforward 2026-02-17T11:25:39.954 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T11:25:39.954 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-17T11:25:39.955 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:25:39.955 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:25:39.955 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:25:39.955 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:25:39.955 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:25:40.064 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:25:40.064 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:25:40.065 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:25:40.066 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:25:40.067 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:25:40.067 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:25:40.067 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:25:40.068 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:25:40.068 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:25:40.068 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:25:40.069 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:25:40.070 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:25:40.071 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T11:25:40.071 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ec-error-rollforward 2026-02-17T11:25:40.082 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:25:40.082 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:40.083 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.77326 2026-02-17T11:25:40.083 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.77326 2026-02-17T11:25:40.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T11:25:40.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T11:25:40.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: main: code=0 2026-02-17T11:25:40.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: main: teardown td/ec-error-rollforward 0 2026-02-17T11:25:40.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/ec-error-rollforward 2026-02-17T11:25:40.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2026-02-17T11:25:40.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-17T11:25:40.085 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:25:40.086 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:25:40.086 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:25:40.086 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:25:40.086 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:25:40.088 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:25:40.088 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:25:40.089 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:25:40.089 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:25:40.090 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:25:40.090 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:25:40.090 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:25:40.091 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:25:40.091 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:25:40.092 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:25:40.092 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:25:40.093 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:25:40.094 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T11:25:40.094 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/ec-error-rollforward 2026-02-17T11:25:40.095 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:25:40.096 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:40.096 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.77326 2026-02-17T11:25:40.096 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.77326 2026-02-17T11:25:40.097 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T11:25:40.097 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T11:25:40.097 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: main: return 0 2026-02-17T11:25:40.098 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T11:25:40.098 DEBUG:teuthology.orchestra.run.trial148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T11:25:40.153 INFO:tasks.workunit:Running workunit osd/osd-bench.sh... 2026-02-17T11:25:40.153 DEBUG:teuthology.orchestra.run.trial148:workunit test osd/osd-bench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh 2026-02-17T11:25:40.210 INFO:tasks.workunit.client.0.trial148.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T11:25:40.215 INFO:tasks.workunit.client.0.trial148.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T11:25:40.215 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T11:25:40.215 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T11:25:40.215 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: export PYTHONWARNINGS=ignore 2026-02-17T11:25:40.215 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: PYTHONWARNINGS=ignore 2026-02-17T11:25:40.215 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: export CEPH_CONF=/dev/null 2026-02-17T11:25:40.215 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: CEPH_CONF=/dev/null 2026-02-17T11:25:40.215 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: main: unset CEPH_ARGS 2026-02-17T11:25:40.215 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: main: local code 2026-02-17T11:25:40.215 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: main: run td/osd-bench 2026-02-17T11:25:40.216 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:22: run: local dir=td/osd-bench 2026-02-17T11:25:40.216 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:23: run: shift 2026-02-17T11:25:40.216 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: export CEPH_MON=127.0.0.1:7106 2026-02-17T11:25:40.216 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: CEPH_MON=127.0.0.1:7106 2026-02-17T11:25:40.216 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:26: run: export CEPH_ARGS 2026-02-17T11:25:40.216 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: uuidgen 2026-02-17T11:25:40.217 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: CEPH_ARGS+='--fsid=b4f1d5c3-d4ef-482c-87ea-d6f606ee201d --auth-supported=none ' 2026-02-17T11:25:40.217 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7106 ' 2026-02-17T11:25:40.217 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:29: run: CEPH_ARGS+='--debug-bluestore 20 ' 2026-02-17T11:25:40.217 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: set 2026-02-17T11:25:40.217 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T11:25:40.219 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: local funcs=TEST_bench 2026-02-17T11:25:40.219 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:32: run: for func in $funcs 2026-02-17T11:25:40.219 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:33: run: setup td/osd-bench 2026-02-17T11:25:40.219 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-bench 2026-02-17T11:25:40.219 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-bench 2026-02-17T11:25:40.219 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-bench 2026-02-17T11:25:40.219 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T11:25:40.219 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-bench KILL 2026-02-17T11:25:40.219 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:25:40.219 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:25:40.219 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:25:40.219 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:25:40.220 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:25:40.220 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:25:40.221 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:25:40.221 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:25:40.222 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:25:40.222 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:25:40.222 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:25:40.223 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:25:40.224 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:25:40.224 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:25:40.224 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:25:40.224 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:25:40.225 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:25:40.227 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T11:25:40.227 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-bench 2026-02-17T11:25:40.228 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:25:40.228 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:40.228 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.88132 2026-02-17T11:25:40.229 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.88132 2026-02-17T11:25:40.229 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T11:25:40.230 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T11:25:40.230 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-bench 2026-02-17T11:25:40.231 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T11:25:40.231 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:40.232 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.88132 2026-02-17T11:25:40.232 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.88132 2026-02-17T11:25:40.233 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T11:25:40.234 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2026-02-17T11:25:40.235 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2026-02-17T11:25:40.235 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T11:25:40.235 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-bench 1' TERM HUP INT 2026-02-17T11:25:40.235 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:34: run: TEST_bench td/osd-bench 2026-02-17T11:25:40.235 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:40: TEST_bench: local dir=td/osd-bench 2026-02-17T11:25:40.235 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:42: TEST_bench: run_mon td/osd-bench a 2026-02-17T11:25:40.235 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-bench 2026-02-17T11:25:40.235 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T11:25:40.235 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T11:25:40.235 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T11:25:40.235 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-bench/a 2026-02-17T11:25:40.235 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bench/a --run-dir=td/osd-bench 2026-02-17T11:25:40.259 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T11:25:40.259 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:25:40.259 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:25:40.259 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:25:40.259 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:40.259 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.88132 2026-02-17T11:25:40.260 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.88132/$cluster-$name.asok' 2026-02-17T11:25:40.260 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bench/a '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.88132/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bench/log --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T11:25:40.287 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T11:25:40.288 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T11:25:40.288 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T11:25:40.288 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T11:25:40.288 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T11:25:40.288 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T11:25:40.288 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T11:25:40.288 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T11:25:40.288 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T11:25:40.289 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:25:40.289 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:40.289 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.88132 2026-02-17T11:25:40.289 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.88132/ceph-mon.a.asok 2026-02-17T11:25:40.289 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T11:25:40.289 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.88132/ceph-mon.a.asok config get fsid 2026-02-17T11:25:40.347 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T11:25:40.347 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T11:25:40.347 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T11:25:40.347 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T11:25:40.348 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T11:25:40.348 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T11:25:40.348 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T11:25:40.348 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T11:25:40.348 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:25:40.348 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:40.348 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.88132 2026-02-17T11:25:40.348 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.88132/ceph-mon.a.asok 2026-02-17T11:25:40.349 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T11:25:40.349 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.88132/ceph-mon.a.asok config get mon_host 2026-02-17T11:25:40.402 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:43: TEST_bench: run_mgr td/osd-bench x 2026-02-17T11:25:40.402 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-bench 2026-02-17T11:25:40.402 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T11:25:40.402 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T11:25:40.402 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T11:25:40.402 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-bench/x 2026-02-17T11:25:40.402 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T11:25:40.512 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T11:25:40.512 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:25:40.512 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:25:40.512 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:25:40.512 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:40.512 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.88132 2026-02-17T11:25:40.512 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.88132/$cluster-$name.asok' 2026-02-17T11:25:40.513 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T11:25:40.513 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bench/x '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.88132/$cluster-$name.asok' --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T11:25:40.535 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:44: TEST_bench: run_osd td/osd-bench 0 2026-02-17T11:25:40.535 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-bench 2026-02-17T11:25:40.535 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:25:40.535 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T11:25:40.535 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:25:40.535 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-bench/0 2026-02-17T11:25:40.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=b4f1d5c3-d4ef-482c-87ea-d6f606ee201d --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 ' 2026-02-17T11:25:40.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:25:40.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:25:40.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:25:40.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-bench/0' 2026-02-17T11:25:40.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-bench/0/journal' 2026-02-17T11:25:40.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:25:40.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:25:40.536 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-bench' 2026-02-17T11:25:40.536 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:25:40.536 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:25:40.536 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:25:40.537 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:25:40.537 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:40.537 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.88132 2026-02-17T11:25:40.537 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.88132/$cluster-$name.asok' 2026-02-17T11:25:40.537 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.88132/$cluster-$name.asok' 2026-02-17T11:25:40.537 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:25:40.537 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:25:40.537 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:25:40.537 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-bench/$name.log' 2026-02-17T11:25:40.537 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-bench/$name.pid' 2026-02-17T11:25:40.537 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:25:40.537 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:25:40.538 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:25:40.538 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:25:40.538 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:25:40.538 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:25:40.538 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-bench/0 2026-02-17T11:25:40.539 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:25:40.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=f0f2c19f-6648-4b9a-bd04-1464a61cce8c 2026-02-17T11:25:40.539 INFO:tasks.workunit.client.0.trial148.stdout:add osd0 f0f2c19f-6648-4b9a-bd04-1464a61cce8c 2026-02-17T11:25:40.539 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 f0f2c19f-6648-4b9a-bd04-1464a61cce8c' 2026-02-17T11:25:40.540 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:25:40.547 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQA0UJRpLwAoIBAAflfNRYlZ2wVlefBSumRzIg== 2026-02-17T11:25:40.547 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQA0UJRpLwAoIBAAflfNRYlZ2wVlefBSumRzIg=="}' 2026-02-17T11:25:40.547 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new f0f2c19f-6648-4b9a-bd04-1464a61cce8c -i td/osd-bench/0/new.json 2026-02-17T11:25:40.655 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:25:40.663 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-bench/0/new.json 2026-02-17T11:25:40.664 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=b4f1d5c3-d4ef-482c-87ea-d6f606ee201d --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.88132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA0UJRpLwAoIBAAflfNRYlZ2wVlefBSumRzIg== --osd-uuid f0f2c19f-6648-4b9a-bd04-1464a61cce8c 2026-02-17T11:25:40.679 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:40.666+0000 7fc77da008c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:40.680 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:40.666+0000 7fc77da008c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:40.681 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:40.666+0000 7fc77da008c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:40.682 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:40.670+0000 7fc77da008c0 -1 bdev(0x55abdd495c00 td/osd-bench/0/block) open stat got: (1) Operation not permitted 2026-02-17T11:25:40.682 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:40.670+0000 7fc77da008c0 -1 bluestore(td/osd-bench/0) _read_fsid unparsable uuid 2026-02-17T11:25:43.282 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-bench/0/keyring 2026-02-17T11:25:43.282 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:25:43.283 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T11:25:43.283 INFO:tasks.workunit.client.0.trial148.stdout:adding osd0 key to auth repository 2026-02-17T11:25:43.283 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-bench/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:25:43.557 INFO:tasks.workunit.client.0.trial148.stdout:start osd.0 2026-02-17T11:25:43.558 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T11:25:43.558 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=b4f1d5c3-d4ef-482c-87ea-d6f606ee201d --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.88132/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:25:43.559 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:25:43.559 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:25:43.559 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:25:43.580 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:43.566+0000 7fa56e5208c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:43.582 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:43.570+0000 7fa56e5208c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:43.583 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:43.570+0000 7fa56e5208c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:43.755 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T11:25:43.755 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:25:43.755 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T11:25:43.756 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:25:43.756 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:25:43.756 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:43.756 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:25:43.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:25:43.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:43.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:25:43.956 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:44.957 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:44.957 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:44.957 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:25:44.957 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:25:44.957 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:44.958 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:25:45.079 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:45.066+0000 7fa56e5208c0 -1 Falling back to public interface 2026-02-17T11:25:45.157 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:46.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:46.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:46.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:25:46.159 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:25:46.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:46.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:25:46.361 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:47.362 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:47.362 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:47.362 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:25:47.363 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:25:47.363 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:47.363 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:25:47.561 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:48.110 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:48.098+0000 7fa56e5208c0 -1 osd.0 0 log_to_monitors true 2026-02-17T11:25:48.562 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:48.562 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:48.562 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:25:48.562 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:25:48.562 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:48.562 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:25:48.769 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:25:49.770 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:25:49.770 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:25:49.770 INFO:tasks.workunit.client.0.trial148.stdout:5 2026-02-17T11:25:49.770 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T11:25:49.770 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:25:49.770 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:25:49.970 INFO:tasks.workunit.client.0.trial148.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3924900015,v1:127.0.0.1:6803/3924900015] [v2:127.0.0.1:6804/3924900015,v1:127.0.0.1:6805/3924900015] exists,up f0f2c19f-6648-4b9a-bd04-1464a61cce8c 2026-02-17T11:25:49.970 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:25:49.970 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:25:49.970 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:25:49.970 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: CEPH_ARGS= 2026-02-17T11:25:49.970 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: ceph-conf --show-config-value osd_bench_small_size_max_iops 2026-02-17T11:25:49.980 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: local osd_bench_small_size_max_iops=100 2026-02-17T11:25:49.980 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: CEPH_ARGS= 2026-02-17T11:25:49.980 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: ceph-conf --show-config-value osd_bench_large_size_max_throughput 2026-02-17T11:25:49.994 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: local osd_bench_large_size_max_throughput=104857600 2026-02-17T11:25:49.994 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: CEPH_ARGS= 2026-02-17T11:25:49.994 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: ceph-conf --show-config-value osd_bench_max_block_size 2026-02-17T11:25:50.002 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: local osd_bench_max_block_size=67108864 2026-02-17T11:25:50.002 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: CEPH_ARGS= 2026-02-17T11:25:50.003 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: ceph-conf --show-config-value osd_bench_duration 2026-02-17T11:25:50.016 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: local osd_bench_duration=30 2026-02-17T11:25:50.016 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:58: TEST_bench: expect_failure td/osd-bench osd_bench_max_block_size ceph tell osd.0 bench 1024 67108865 2026-02-17T11:25:50.016 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: local dir=td/osd-bench 2026-02-17T11:25:50.016 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2026: expect_failure: shift 2026-02-17T11:25:50.016 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2027: expect_failure: local expected=osd_bench_max_block_size 2026-02-17T11:25:50.016 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: shift 2026-02-17T11:25:50.016 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2029: expect_failure: local success 2026-02-17T11:25:50.016 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2031: expect_failure: ceph tell osd.0 bench 1024 67108865 2026-02-17T11:25:50.082 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: expect_failure: success=false 2026-02-17T11:25:50.082 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: expect_failure: false 2026-02-17T11:25:50.082 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: expect_failure: grep --quiet osd_bench_max_block_size td/osd-bench/out 2026-02-17T11:25:50.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2041: expect_failure: return 0 2026-02-17T11:25:50.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:64: TEST_bench: local bsize=1024 2026-02-17T11:25:50.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:65: TEST_bench: local max_count=3072000 2026-02-17T11:25:50.084 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:66: TEST_bench: expect_failure td/osd-bench bench_small_size_max_iops ceph tell osd.0 bench 3072001 1024 2026-02-17T11:25:50.085 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: local dir=td/osd-bench 2026-02-17T11:25:50.085 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2026: expect_failure: shift 2026-02-17T11:25:50.085 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2027: expect_failure: local expected=bench_small_size_max_iops 2026-02-17T11:25:50.085 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: shift 2026-02-17T11:25:50.085 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2029: expect_failure: local success 2026-02-17T11:25:50.085 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2031: expect_failure: ceph tell osd.0 bench 3072001 1024 2026-02-17T11:25:50.157 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: expect_failure: success=false 2026-02-17T11:25:50.157 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: expect_failure: false 2026-02-17T11:25:50.157 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: expect_failure: grep --quiet bench_small_size_max_iops td/osd-bench/out 2026-02-17T11:25:50.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2041: expect_failure: return 0 2026-02-17T11:25:50.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:72: TEST_bench: local bsize=1048577 2026-02-17T11:25:50.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:73: TEST_bench: local max_count=3145728000 2026-02-17T11:25:50.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:74: TEST_bench: expect_failure td/osd-bench osd_bench_large_size_max_throughput ceph tell osd.0 bench 3145728001 1048577 2026-02-17T11:25:50.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: local dir=td/osd-bench 2026-02-17T11:25:50.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2026: expect_failure: shift 2026-02-17T11:25:50.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2027: expect_failure: local expected=osd_bench_large_size_max_throughput 2026-02-17T11:25:50.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: shift 2026-02-17T11:25:50.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2029: expect_failure: local success 2026-02-17T11:25:50.159 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2031: expect_failure: ceph tell osd.0 bench 3145728001 1048577 2026-02-17T11:25:50.225 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2034: expect_failure: success=false 2026-02-17T11:25:50.225 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: expect_failure: false 2026-02-17T11:25:50.225 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2037: expect_failure: grep --quiet osd_bench_large_size_max_throughput td/osd-bench/out 2026-02-17T11:25:50.226 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2041: expect_failure: return 0 2026-02-17T11:25:50.226 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:80: TEST_bench: ceph tell osd.0 bench 2026-02-17T11:25:51.951 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:25:51.951 INFO:tasks.workunit.client.0.trial148.stdout: "bytes_written": 1073741824, 2026-02-17T11:25:51.951 INFO:tasks.workunit.client.0.trial148.stdout: "blocksize": 4194304, 2026-02-17T11:25:51.951 INFO:tasks.workunit.client.0.trial148.stdout: "elapsed_sec": 0.73484322800000001, 2026-02-17T11:25:51.951 INFO:tasks.workunit.client.0.trial148.stdout: "bytes_per_sec": 1461184893.7117782, 2026-02-17T11:25:51.951 INFO:tasks.workunit.client.0.trial148.stdout: "iops": 348.37362616342978 2026-02-17T11:25:51.952 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:25:51.965 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:84: TEST_bench: ceph tell osd.0 bench 10 14456 4444 3 2026-02-17T11:25:52.034 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:25:52.035 INFO:tasks.workunit.client.0.trial148.stdout: "bytes_written": 10, 2026-02-17T11:25:52.035 INFO:tasks.workunit.client.0.trial148.stdout: "blocksize": 14456, 2026-02-17T11:25:52.035 INFO:tasks.workunit.client.0.trial148.stdout: "elapsed_sec": 0.00048092799999999999, 2026-02-17T11:25:52.035 INFO:tasks.workunit.client.0.trial148.stdout: "bytes_per_sec": 20793.133275667045, 2026-02-17T11:25:52.035 INFO:tasks.workunit.client.0.trial148.stdout: "iops": 1.4383739122625239 2026-02-17T11:25:52.035 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:25:52.041 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:90: TEST_bench: ceph tell osd.0 bench 1 14456 2026-02-17T11:25:52.107 INFO:tasks.workunit.client.0.trial148.stdout:{ 2026-02-17T11:25:52.107 INFO:tasks.workunit.client.0.trial148.stdout: "bytes_written": 1, 2026-02-17T11:25:52.107 INFO:tasks.workunit.client.0.trial148.stdout: "blocksize": 14456, 2026-02-17T11:25:52.107 INFO:tasks.workunit.client.0.trial148.stdout: "elapsed_sec": 0.00037644499999999999, 2026-02-17T11:25:52.107 INFO:tasks.workunit.client.0.trial148.stdout: "bytes_per_sec": 2656.4305542642351, 2026-02-17T11:25:52.107 INFO:tasks.workunit.client.0.trial148.stdout: "iops": 0.18375972290151046 2026-02-17T11:25:52.107 INFO:tasks.workunit.client.0.trial148.stdout:} 2026-02-17T11:25:52.115 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:35: run: teardown td/osd-bench 2026-02-17T11:25:52.115 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-bench 2026-02-17T11:25:52.115 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T11:25:52.115 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-bench KILL 2026-02-17T11:25:52.115 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:25:52.115 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:25:52.116 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:25:52.116 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:25:52.116 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:25:52.423 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:25:52.424 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:25:52.425 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:25:52.425 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:25:52.426 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:25:52.427 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:25:52.427 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:25:52.428 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:25:52.428 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:25:52.429 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:25:52.429 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:25:52.430 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:25:52.431 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T11:25:52.431 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-bench 2026-02-17T11:25:52.464 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:25:52.464 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:52.464 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.88132 2026-02-17T11:25:52.464 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.88132 2026-02-17T11:25:52.465 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T11:25:52.465 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T11:25:52.465 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2377: main: code=0 2026-02-17T11:25:52.465 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: main: teardown td/osd-bench 0 2026-02-17T11:25:52.465 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-bench 2026-02-17T11:25:52.465 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=0 2026-02-17T11:25:52.465 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-bench KILL 2026-02-17T11:25:52.466 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:25:52.466 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:25:52.466 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:25:52.466 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:25:52.466 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:25:52.468 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:25:52.468 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:25:52.469 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:25:52.469 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:25:52.470 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:25:52.470 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:25:52.471 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:25:52.472 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:25:52.472 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:25:52.472 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:25:52.472 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:25:52.473 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:25:52.474 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-17T11:25:52.474 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-bench 2026-02-17T11:25:52.475 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:25:52.475 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:52.476 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.88132 2026-02-17T11:25:52.476 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.88132 2026-02-17T11:25:52.477 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T11:25:52.477 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T11:25:52.477 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2382: main: return 0 2026-02-17T11:25:52.478 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T11:25:52.478 DEBUG:teuthology.orchestra.run.trial148:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T11:25:52.529 INFO:tasks.workunit:Running workunit osd/osd-bluefs-volume-ops.sh... 2026-02-17T11:25:52.529 DEBUG:teuthology.orchestra.run.trial148:workunit test osd/osd-bluefs-volume-ops.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh 2026-02-17T11:25:52.583 INFO:tasks.workunit.client.0.trial148.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-17T11:25:52.588 INFO:tasks.workunit.client.0.trial148.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-17T11:25:52.588 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T11:25:52.588 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2370: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-17T11:25:52.588 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: export PYTHONWARNINGS=ignore 2026-02-17T11:25:52.588 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2371: main: PYTHONWARNINGS=ignore 2026-02-17T11:25:52.588 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: export CEPH_CONF=/dev/null 2026-02-17T11:25:52.588 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2372: main: CEPH_CONF=/dev/null 2026-02-17T11:25:52.588 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2373: main: unset CEPH_ARGS 2026-02-17T11:25:52.589 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2375: main: local code 2026-02-17T11:25:52.589 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2376: main: run td/osd-bluefs-volume-ops 2026-02-17T11:25:52.589 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:8: run: local dir=td/osd-bluefs-volume-ops 2026-02-17T11:25:52.589 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:9: run: shift 2026-02-17T11:25:52.589 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: set 2026-02-17T11:25:52.589 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-17T11:25:52.591 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: local 'funcs=TEST_bluestore 2026-02-17T11:25:52.591 INFO:tasks.workunit.client.0.trial148.stderr:TEST_bluestore2 2026-02-17T11:25:52.591 INFO:tasks.workunit.client.0.trial148.stderr:TEST_bluestore_expand' 2026-02-17T11:25:52.592 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-17T11:25:52.592 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-17T11:25:52.592 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:131: setup: local dir=td/osd-bluefs-volume-ops 2026-02-17T11:25:52.592 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:132: setup: teardown td/osd-bluefs-volume-ops 2026-02-17T11:25:52.592 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-17T11:25:52.592 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs= 2026-02-17T11:25:52.592 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-17T11:25:52.592 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:25:52.592 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:25:52.592 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:25:52.593 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:25:52.593 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:25:52.593 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:25:52.594 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:25:52.594 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:25:52.595 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:25:52.595 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:25:52.596 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:25:52.596 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:25:52.597 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:25:52.597 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:25:52.598 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:25:52.598 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:25:52.598 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:25:52.600 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' no = yes -o '' = 1 ']' 2026-02-17T11:25:52.600 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-17T11:25:52.601 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:25:52.601 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:52.602 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.91057 2026-02-17T11:25:52.602 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.91057 2026-02-17T11:25:52.602 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' no = yes ']' 2026-02-17T11:25:52.603 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:207: teardown: return 0 2026-02-17T11:25:52.603 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:133: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-17T11:25:52.604 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: get_asok_dir 2026-02-17T11:25:52.604 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:52.604 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.91057 2026-02-17T11:25:52.604 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:134: setup: mkdir -p /tmp/ceph-asok.91057 2026-02-17T11:25:52.605 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: ulimit -n 2026-02-17T11:25:52.607 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:135: setup: '[' 1024 -le 1024 ']' 2026-02-17T11:25:52.607 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:136: setup: ulimit -n 4096 2026-02-17T11:25:52.607 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:138: setup: '[' -z '' ']' 2026-02-17T11:25:52.607 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:139: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-17T11:25:52.607 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore td/osd-bluefs-volume-ops 2026-02-17T11:25:52.608 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:20: TEST_bluestore: local dir=td/osd-bluefs-volume-ops 2026-02-17T11:25:52.608 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: ulimit -n 2026-02-17T11:25:52.608 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: local flimit=4096 2026-02-17T11:25:52.608 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:23: TEST_bluestore: '[' 4096 -lt 1536 ']' 2026-02-17T11:25:52.608 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: export CEPH_MON=127.0.0.1:7146 2026-02-17T11:25:52.608 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: CEPH_MON=127.0.0.1:7146 2026-02-17T11:25:52.608 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:27: TEST_bluestore: export CEPH_ARGS 2026-02-17T11:25:52.608 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: uuidgen 2026-02-17T11:25:52.610 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: CEPH_ARGS+='--fsid=d21d31f5-9fed-4c79-824d-b2b49aaae09e --auth-supported=none ' 2026-02-17T11:25:52.610 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:29: TEST_bluestore: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-17T11:25:52.610 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:30: TEST_bluestore: CEPH_ARGS+='--bluestore_block_size=2147483648 ' 2026-02-17T11:25:52.610 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:31: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-17T11:25:52.610 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:32: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-17T11:25:52.610 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:33: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_size=536870912 ' 2026-02-17T11:25:52.611 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:34: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_create=true ' 2026-02-17T11:25:52.611 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:35: TEST_bluestore: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-17T11:25:52.611 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:37: TEST_bluestore: CEPH_ARGS+='--bluestore_allocation_from_file=1 ' 2026-02-17T11:25:52.611 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:39: TEST_bluestore: run_mon td/osd-bluefs-volume-ops a 2026-02-17T11:25:52.611 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:448: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-17T11:25:52.611 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:449: run_mon: shift 2026-02-17T11:25:52.611 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:450: run_mon: local id=a 2026-02-17T11:25:52.611 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:451: run_mon: shift 2026-02-17T11:25:52.611 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:452: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-17T11:25:52.611 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:455: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-17T11:25:52.632 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: get_asok_path 2026-02-17T11:25:52.632 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:25:52.632 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:25:52.632 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:25:52.632 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:52.633 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.91057 2026-02-17T11:25:52.633 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.91057/$cluster-$name.asok' 2026-02-17T11:25:52.633 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:462: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.91057/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-17T11:25:52.661 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: cat 2026-02-17T11:25:52.662 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a fsid 2026-02-17T11:25:52.662 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T11:25:52.663 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T11:25:52.663 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=fsid 2026-02-17T11:25:52.663 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .fsid 2026-02-17T11:25:52.663 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T11:25:52.663 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T11:25:52.663 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T11:25:52.664 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:25:52.664 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:52.664 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.91057 2026-02-17T11:25:52.664 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.91057/ceph-mon.a.asok 2026-02-17T11:25:52.665 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T11:25:52.665 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.91057/ceph-mon.a.asok config get fsid 2026-02-17T11:25:52.721 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:487: run_mon: get_config mon a mon_host 2026-02-17T11:25:52.721 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1125: get_config: local daemon=mon 2026-02-17T11:25:52.721 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1126: get_config: local id=a 2026-02-17T11:25:52.721 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1127: get_config: local config=mon_host 2026-02-17T11:25:52.721 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1132: get_config: jq -r .mon_host 2026-02-17T11:25:52.721 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: get_asok_path mon.a 2026-02-17T11:25:52.721 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name=mon.a 2026-02-17T11:25:52.721 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n mon.a ']' 2026-02-17T11:25:52.721 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: get_asok_dir 2026-02-17T11:25:52.722 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:52.722 INFO:tasks.workunit.client.0.trial148.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.91057 2026-02-17T11:25:52.722 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:118: get_asok_path: echo /tmp/ceph-asok.91057/ceph-mon.a.asok 2026-02-17T11:25:52.722 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: CEPH_ARGS= 2026-02-17T11:25:52.723 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1129: get_config: ceph --format json daemon /tmp/ceph-asok.91057/ceph-mon.a.asok config get mon_host 2026-02-17T11:25:52.776 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:40: TEST_bluestore: run_mgr td/osd-bluefs-volume-ops x 2026-02-17T11:25:52.777 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:553: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-17T11:25:52.777 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:554: run_mgr: shift 2026-02-17T11:25:52.777 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:555: run_mgr: local id=x 2026-02-17T11:25:52.777 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:556: run_mgr: shift 2026-02-17T11:25:52.777 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:557: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-17T11:25:52.777 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:559: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-17T11:25:52.888 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: get_asok_path 2026-02-17T11:25:52.888 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:25:52.888 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:25:52.888 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:25:52.888 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:52.888 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.91057 2026-02-17T11:25:52.888 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.91057/$cluster-$name.asok' 2026-02-17T11:25:52.889 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T11:25:52.890 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:561: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.91057/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-17T11:25:52.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:41: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 0 2026-02-17T11:25:52.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T11:25:52.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:25:52.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=0 2026-02-17T11:25:52.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:25:52.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-17T11:25:52.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=d21d31f5-9fed-4c79-824d-b2b49aaae09e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-17T11:25:52.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:25:52.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:25:52.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:25:52.908 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-17T11:25:52.909 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-17T11:25:52.909 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:25:52.909 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:25:52.909 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T11:25:52.909 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:25:52.909 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:25:52.909 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:25:52.909 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:25:52.909 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:25:52.909 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.91057 2026-02-17T11:25:52.909 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.91057/$cluster-$name.asok' 2026-02-17T11:25:52.909 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.91057/$cluster-$name.asok' 2026-02-17T11:25:52.909 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:25:52.909 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:25:52.909 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:25:52.910 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T11:25:52.910 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T11:25:52.910 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:25:52.910 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:25:52.910 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:25:52.910 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:25:52.910 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:25:52.910 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:25:52.910 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-17T11:25:52.911 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:25:52.912 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=6bdfae60-ac20-4566-b78f-bdacf9f42b09 2026-02-17T11:25:52.912 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd0 6bdfae60-ac20-4566-b78f-bdacf9f42b09' 2026-02-17T11:25:52.912 INFO:tasks.workunit.client.0.trial148.stdout:add osd0 6bdfae60-ac20-4566-b78f-bdacf9f42b09 2026-02-17T11:25:52.912 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:25:52.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBAUJRp4L2BNhAAJk+XECFcWd/JH4Nc+7tVxw== 2026-02-17T11:25:52.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBAUJRp4L2BNhAAJk+XECFcWd/JH4Nc+7tVxw=="}' 2026-02-17T11:25:52.922 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 6bdfae60-ac20-4566-b78f-bdacf9f42b09 -i td/osd-bluefs-volume-ops/0/new.json 2026-02-17T11:25:53.031 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:25:53.039 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-17T11:25:53.040 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 0 --fsid=d21d31f5-9fed-4c79-824d-b2b49aaae09e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.91057/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBAUJRp4L2BNhAAJk+XECFcWd/JH4Nc+7tVxw== --osd-uuid 6bdfae60-ac20-4566-b78f-bdacf9f42b09 2026-02-17T11:25:53.055 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:53.042+0000 7f6ab1d338c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:53.056 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:53.042+0000 7f6ab1d338c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:53.057 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:53.042+0000 7f6ab1d338c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:53.057 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:53.046+0000 7f6ab1d338c0 -1 bdev(0x5637ea3dbc00 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-17T11:25:53.057 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:53.046+0000 7f6ab1d338c0 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-17T11:25:59.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-17T11:25:59.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:25:59.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd0 key to auth repository 2026-02-17T11:25:59.660 INFO:tasks.workunit.client.0.trial148.stdout:adding osd0 key to auth repository 2026-02-17T11:25:59.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:25:59.938 INFO:tasks.workunit.client.0.trial148.stdout:start osd.0 2026-02-17T11:25:59.939 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.0 2026-02-17T11:25:59.939 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 0 --fsid=d21d31f5-9fed-4c79-824d-b2b49aaae09e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.91057/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:25:59.939 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:25:59.939 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:25:59.939 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:25:59.954 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:59.942+0000 7f41fd45b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:59.955 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:59.942+0000 7f41fd45b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:25:59.956 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:25:59.942+0000 7f41fd45b8c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:26:00.135 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 0 2026-02-17T11:26:00.135 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:26:00.135 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=0 2026-02-17T11:26:00.135 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:26:00.135 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:26:00.135 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:00.135 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:26:00.136 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:26:00.136 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:00.136 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:26:00.332 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:01.333 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:01.334 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:01.334 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:26:01.335 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:26:01.335 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:01.335 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:26:01.538 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:01.980 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:01.966+0000 7f41fd45b8c0 -1 Falling back to public interface 2026-02-17T11:26:02.540 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:02.540 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:02.540 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:26:02.541 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:26:02.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:02.541 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:26:02.740 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:03.742 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:03.743 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:03.743 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:26:03.744 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:26:03.744 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:03.744 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:26:03.945 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:04.946 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:04.946 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:04.946 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:26:04.947 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:26:04.947 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:04.947 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:26:05.150 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:06.151 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:06.152 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:06.152 INFO:tasks.workunit.client.0.trial148.stdout:5 2026-02-17T11:26:06.152 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T11:26:06.152 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:06.152 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:26:06.351 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:07.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:07.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:07.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2026-02-17T11:26:07.352 INFO:tasks.workunit.client.0.trial148.stdout:6 2026-02-17T11:26:07.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:07.352 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:26:07.533 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:07.522+0000 7f41fd45b8c0 -1 osd.0 0 log_to_monitors true 2026-02-17T11:26:07.554 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:08.062 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:08.054+0000 7f41f8c14640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T11:26:08.555 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:08.556 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:08.556 INFO:tasks.workunit.client.0.trial148.stdout:7 2026-02-17T11:26:08.556 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2026-02-17T11:26:08.556 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:08.556 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.0 up' 2026-02-17T11:26:08.756 INFO:tasks.workunit.client.0.trial148.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3217452680,v1:127.0.0.1:6803/3217452680] [v2:127.0.0.1:6804/3217452680,v1:127.0.0.1:6805/3217452680] exists,up 6bdfae60-ac20-4566-b78f-bdacf9f42b09 2026-02-17T11:26:08.756 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:26:08.756 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:26:08.756 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:26:08.756 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-17T11:26:08.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: osd_pid0=92535 2026-02-17T11:26:08.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:43: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 1 2026-02-17T11:26:08.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T11:26:08.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:26:08.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=1 2026-02-17T11:26:08.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:26:08.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-17T11:26:08.757 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=d21d31f5-9fed-4c79-824d-b2b49aaae09e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-17T11:26:08.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:26:08.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:26:08.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:26:08.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-17T11:26:08.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-17T11:26:08.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:26:08.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:26:08.758 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T11:26:08.758 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:26:08.758 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:26:08.758 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:26:08.758 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:26:08.758 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:26:08.758 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.91057 2026-02-17T11:26:08.758 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.91057/$cluster-$name.asok' 2026-02-17T11:26:08.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.91057/$cluster-$name.asok' 2026-02-17T11:26:08.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:26:08.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:26:08.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:26:08.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T11:26:08.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T11:26:08.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:26:08.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:26:08.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:26:08.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:26:08.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:26:08.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:26:08.759 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-17T11:26:08.760 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:26:08.761 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=6729502d-67cf-4612-9ff1-bdb610f9ed98 2026-02-17T11:26:08.761 INFO:tasks.workunit.client.0.trial148.stdout:add osd1 6729502d-67cf-4612-9ff1-bdb610f9ed98 2026-02-17T11:26:08.761 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd1 6729502d-67cf-4612-9ff1-bdb610f9ed98' 2026-02-17T11:26:08.761 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:26:08.771 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBQUJRp0N9/LRAAG0q0tCqGlpYeAVQmfDz2kQ== 2026-02-17T11:26:08.771 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBQUJRp0N9/LRAAG0q0tCqGlpYeAVQmfDz2kQ=="}' 2026-02-17T11:26:08.771 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 6729502d-67cf-4612-9ff1-bdb610f9ed98 -i td/osd-bluefs-volume-ops/1/new.json 2026-02-17T11:26:08.976 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:26:08.985 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-bluefs-volume-ops/1/new.json 2026-02-17T11:26:08.986 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 1 --fsid=d21d31f5-9fed-4c79-824d-b2b49aaae09e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.91057/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBQUJRp0N9/LRAAG0q0tCqGlpYeAVQmfDz2kQ== --osd-uuid 6729502d-67cf-4612-9ff1-bdb610f9ed98 2026-02-17T11:26:09.002 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:08.994+0000 7f3c965008c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:26:09.003 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:08.994+0000 7f3c965008c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:26:09.004 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:08.994+0000 7f3c965008c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:26:09.005 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:08.994+0000 7f3c965008c0 -1 bdev(0x5567e1ec5c00 td/osd-bluefs-volume-ops/1/block) open stat got: (1) Operation not permitted 2026-02-17T11:26:09.005 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:08.994+0000 7f3c965008c0 -1 bluestore(td/osd-bluefs-volume-ops/1) _read_fsid unparsable uuid 2026-02-17T11:26:15.583 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-bluefs-volume-ops/1/keyring 2026-02-17T11:26:15.583 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:26:15.584 INFO:tasks.workunit.client.0.trial148.stdout:adding osd1 key to auth repository 2026-02-17T11:26:15.584 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd1 key to auth repository 2026-02-17T11:26:15.584 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-bluefs-volume-ops/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:26:15.852 INFO:tasks.workunit.client.0.trial148.stdout:start osd.1 2026-02-17T11:26:15.853 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.1 2026-02-17T11:26:15.853 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 1 --fsid=d21d31f5-9fed-4c79-824d-b2b49aaae09e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.91057/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:26:15.853 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:26:15.853 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:26:15.853 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:26:15.874 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:15.866+0000 7f36cb2668c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:26:15.876 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:15.866+0000 7f36cb2668c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:26:15.877 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:15.866+0000 7f36cb2668c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:26:16.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 1 2026-02-17T11:26:16.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:26:16.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=1 2026-02-17T11:26:16.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:26:16.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:26:16.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:16.052 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:26:16.052 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:26:16.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:16.053 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:26:16.251 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:17.252 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:17.253 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:17.253 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:26:17.253 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:26:17.253 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:17.253 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:26:17.449 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:17.916 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:17.906+0000 7f36cb2668c0 -1 Falling back to public interface 2026-02-17T11:26:18.450 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:18.450 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:18.450 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:26:18.451 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:26:18.451 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:18.451 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:26:18.644 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:19.645 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:19.645 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:19.645 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:26:19.646 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:26:19.646 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:19.646 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:26:19.844 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:20.845 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:20.845 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:20.845 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:26:20.845 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:26:20.845 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:20.846 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:26:21.048 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:22.050 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:22.050 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:22.051 INFO:tasks.workunit.client.0.trial148.stdout:5 2026-02-17T11:26:22.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T11:26:22.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:22.051 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:26:22.252 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:23.205 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:23.194+0000 7f36cb2668c0 -1 osd.1 0 log_to_monitors true 2026-02-17T11:26:23.253 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:23.254 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:23.254 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2026-02-17T11:26:23.254 INFO:tasks.workunit.client.0.trial148.stdout:6 2026-02-17T11:26:23.254 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:23.255 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:26:23.448 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:24.449 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:24.449 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:24.450 INFO:tasks.workunit.client.0.trial148.stdout:7 2026-02-17T11:26:24.450 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2026-02-17T11:26:24.450 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:24.450 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.1 up' 2026-02-17T11:26:24.653 INFO:tasks.workunit.client.0.trial148.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1038922524,v1:127.0.0.1:6811/1038922524] [v2:127.0.0.1:6812/1038922524,v1:127.0.0.1:6813/1038922524] exists,up 6729502d-67cf-4612-9ff1-bdb610f9ed98 2026-02-17T11:26:24.653 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:26:24.654 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:26:24.654 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:26:24.654 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-17T11:26:24.657 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: osd_pid1=94824 2026-02-17T11:26:24.657 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:45: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 2 2026-02-17T11:26:24.657 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T11:26:24.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:26:24.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=2 2026-02-17T11:26:24.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:26:24.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-17T11:26:24.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=d21d31f5-9fed-4c79-824d-b2b49aaae09e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-17T11:26:24.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:26:24.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:26:24.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:26:24.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-17T11:26:24.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-17T11:26:24.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:26:24.658 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:26:24.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T11:26:24.659 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:26:24.659 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:26:24.659 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:26:24.659 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:26:24.659 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:26:24.659 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.91057 2026-02-17T11:26:24.659 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.91057/$cluster-$name.asok' 2026-02-17T11:26:24.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.91057/$cluster-$name.asok' 2026-02-17T11:26:24.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:26:24.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:26:24.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:26:24.659 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T11:26:24.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T11:26:24.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:26:24.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:26:24.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:26:24.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:26:24.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:26:24.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:26:24.660 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-17T11:26:24.661 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:26:24.661 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=9f84f391-d5b6-4798-a7f1-0b1b49784e34 2026-02-17T11:26:24.661 INFO:tasks.workunit.client.0.trial148.stdout:add osd2 9f84f391-d5b6-4798-a7f1-0b1b49784e34 2026-02-17T11:26:24.662 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd2 9f84f391-d5b6-4798-a7f1-0b1b49784e34' 2026-02-17T11:26:24.662 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:26:24.671 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBgUJRp+KCAJxAAidKaumUE+bznZ4cvX5ptJQ== 2026-02-17T11:26:24.672 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBgUJRp+KCAJxAAidKaumUE+bznZ4cvX5ptJQ=="}' 2026-02-17T11:26:24.672 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 9f84f391-d5b6-4798-a7f1-0b1b49784e34 -i td/osd-bluefs-volume-ops/2/new.json 2026-02-17T11:26:24.881 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:26:24.890 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-bluefs-volume-ops/2/new.json 2026-02-17T11:26:24.891 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 2 --fsid=d21d31f5-9fed-4c79-824d-b2b49aaae09e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.91057/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBgUJRp+KCAJxAAidKaumUE+bznZ4cvX5ptJQ== --osd-uuid 9f84f391-d5b6-4798-a7f1-0b1b49784e34 2026-02-17T11:26:24.907 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:24.898+0000 7fc26bbd58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:26:24.909 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:24.898+0000 7fc26bbd58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:26:24.910 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:24.898+0000 7fc26bbd58c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:26:24.910 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:24.902+0000 7fc26bbd58c0 -1 bdev(0x559e4d27fc00 td/osd-bluefs-volume-ops/2/block) open stat got: (1) Operation not permitted 2026-02-17T11:26:24.911 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:24.902+0000 7fc26bbd58c0 -1 bluestore(td/osd-bluefs-volume-ops/2) _read_fsid unparsable uuid 2026-02-17T11:26:31.496 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-bluefs-volume-ops/2/keyring 2026-02-17T11:26:31.496 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:26:31.497 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd2 key to auth repository 2026-02-17T11:26:31.497 INFO:tasks.workunit.client.0.trial148.stdout:adding osd2 key to auth repository 2026-02-17T11:26:31.497 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-bluefs-volume-ops/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:26:31.781 INFO:tasks.workunit.client.0.trial148.stdout:start osd.2 2026-02-17T11:26:31.781 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.2 2026-02-17T11:26:31.781 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 2 --fsid=d21d31f5-9fed-4c79-824d-b2b49aaae09e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.91057/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:26:31.782 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:26:31.782 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:26:31.782 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:26:31.805 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:31.793+0000 7fd5c86848c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:26:31.806 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:31.797+0000 7fd5c86848c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:26:31.807 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:31.797+0000 7fd5c86848c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:26:31.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 2 2026-02-17T11:26:31.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:26:31.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=2 2026-02-17T11:26:31.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:26:31.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:26:31.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:31.978 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:26:31.979 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:26:31.979 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:31.979 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:26:32.185 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:33.186 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:33.187 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:33.187 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:26:33.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:26:33.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:33.188 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:26:33.386 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:33.785 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:33.773+0000 7fd5c86848c0 -1 Falling back to public interface 2026-02-17T11:26:34.387 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:34.387 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:34.387 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:26:34.387 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:26:34.388 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:34.388 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:26:34.590 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:35.592 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:35.592 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:35.592 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:26:35.593 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:26:35.593 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:35.593 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:26:35.794 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:36.796 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:36.796 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:36.796 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:26:36.796 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:26:36.796 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:36.796 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:26:36.996 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:37.997 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:37.997 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:37.997 INFO:tasks.workunit.client.0.trial148.stdout:5 2026-02-17T11:26:37.997 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T11:26:37.997 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:37.997 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:26:38.195 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:39.196 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:39.196 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:39.196 INFO:tasks.workunit.client.0.trial148.stdout:6 2026-02-17T11:26:39.197 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2026-02-17T11:26:39.197 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:39.197 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:26:39.349 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:39.337+0000 7fd5c86848c0 -1 osd.2 0 log_to_monitors true 2026-02-17T11:26:39.397 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:40.398 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:40.399 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:40.399 INFO:tasks.workunit.client.0.trial148.stdout:7 2026-02-17T11:26:40.400 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2026-02-17T11:26:40.400 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:40.400 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.2 up' 2026-02-17T11:26:40.599 INFO:tasks.workunit.client.0.trial148.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2926837838,v1:127.0.0.1:6819/2926837838] [v2:127.0.0.1:6820/2926837838,v1:127.0.0.1:6821/2926837838] exists,up 9f84f391-d5b6-4798-a7f1-0b1b49784e34 2026-02-17T11:26:40.607 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:26:40.607 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:26:40.608 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:26:40.608 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-17T11:26:40.608 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: osd_pid2=97317 2026-02-17T11:26:40.608 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:47: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 3 2026-02-17T11:26:40.608 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-17T11:26:40.608 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: shift 2026-02-17T11:26:40.609 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: local id=3 2026-02-17T11:26:40.609 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: shift 2026-02-17T11:26:40.609 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-17T11:26:40.609 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: local 'ceph_args=--fsid=d21d31f5-9fed-4c79-824d-b2b49aaae09e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-17T11:26:40.609 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-17T11:26:40.609 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-17T11:26:40.610 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-17T11:26:40.610 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-17T11:26:40.610 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-17T11:26:40.610 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --chdir=' 2026-02-17T11:26:40.610 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+= 2026-02-17T11:26:40.610 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-17T11:26:40.611 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: get_asok_path 2026-02-17T11:26:40.611 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:116: get_asok_path: local name= 2026-02-17T11:26:40.611 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:117: get_asok_path: '[' -n '' ']' 2026-02-17T11:26:40.611 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: get_asok_dir 2026-02-17T11:26:40.611 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:26:40.611 INFO:tasks.workunit.client.0.trial148.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.91057 2026-02-17T11:26:40.612 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:120: get_asok_path: echo '/tmp/ceph-asok.91057/$cluster-$name.asok' 2026-02-17T11:26:40.612 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.91057/$cluster-$name.asok' 2026-02-17T11:26:40.612 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' --debug-osd=20' 2026-02-17T11:26:40.612 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+=' --debug-ms=1' 2026-02-17T11:26:40.612 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: ceph_args+=' --debug-monc=20' 2026-02-17T11:26:40.613 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:652: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-17T11:26:40.613 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-17T11:26:40.613 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-17T11:26:40.613 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-17T11:26:40.613 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-17T11:26:40.614 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-17T11:26:40.614 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: ceph_args+=' ' 2026-02-17T11:26:40.614 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph_args+= 2026-02-17T11:26:40.614 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:660: run_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-17T11:26:40.614 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: uuidgen 2026-02-17T11:26:40.614 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: local uuid=82269018-5625-4e3c-9b77-fbf80b58dd33 2026-02-17T11:26:40.614 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:663: run_osd: echo 'add osd3 82269018-5625-4e3c-9b77-fbf80b58dd33' 2026-02-17T11:26:40.615 INFO:tasks.workunit.client.0.trial148.stdout:add osd3 82269018-5625-4e3c-9b77-fbf80b58dd33 2026-02-17T11:26:40.616 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: ceph-authtool --gen-print-key 2026-02-17T11:26:40.617 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:664: run_osd: OSD_SECRET=AQBwUJRpUYUxJBAA+K8WldHiuQM89JbxGtnlRA== 2026-02-17T11:26:40.617 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:665: run_osd: echo '{"cephx_secret": "AQBwUJRpUYUxJBAA+K8WldHiuQM89JbxGtnlRA=="}' 2026-02-17T11:26:40.617 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: ceph osd new 82269018-5625-4e3c-9b77-fbf80b58dd33 -i td/osd-bluefs-volume-ops/3/new.json 2026-02-17T11:26:40.821 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:26:40.830 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: rm td/osd-bluefs-volume-ops/3/new.json 2026-02-17T11:26:40.831 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: ceph-osd -i 3 --fsid=d21d31f5-9fed-4c79-824d-b2b49aaae09e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.91057/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBwUJRpUYUxJBAA+K8WldHiuQM89JbxGtnlRA== --osd-uuid 82269018-5625-4e3c-9b77-fbf80b58dd33 2026-02-17T11:26:40.847 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:40.837+0000 7f192e0d68c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:26:40.848 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:40.837+0000 7f192e0d68c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:26:40.850 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:40.837+0000 7f192e0d68c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:26:40.850 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:40.837+0000 7f192e0d68c0 -1 bdev(0x56213b001c00 td/osd-bluefs-volume-ops/3/block) open stat got: (1) Operation not permitted 2026-02-17T11:26:40.850 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:40.837+0000 7f192e0d68c0 -1 bluestore(td/osd-bluefs-volume-ops/3) _read_fsid unparsable uuid 2026-02-17T11:26:47.443 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:670: run_osd: local key_fn=td/osd-bluefs-volume-ops/3/keyring 2026-02-17T11:26:47.444 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:671: run_osd: cat 2026-02-17T11:26:47.444 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: echo adding osd3 key to auth repository 2026-02-17T11:26:47.445 INFO:tasks.workunit.client.0.trial148.stdout:adding osd3 key to auth repository 2026-02-17T11:26:47.445 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:676: run_osd: ceph -i td/osd-bluefs-volume-ops/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-17T11:26:47.711 INFO:tasks.workunit.client.0.trial148.stdout:start osd.3 2026-02-17T11:26:47.712 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:677: run_osd: echo start osd.3 2026-02-17T11:26:47.712 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:678: run_osd: ceph-osd -i 3 --fsid=d21d31f5-9fed-4c79-824d-b2b49aaae09e --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.91057/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-17T11:26:47.712 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: ceph osd dump --format=json 2026-02-17T11:26:47.712 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: jq '.flags_set[]' 2026-02-17T11:26:47.712 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:681: run_osd: grep -q '"noup"' 2026-02-17T11:26:47.734 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:47.721+0000 7f5188ea18c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:26:47.736 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:47.725+0000 7f5188ea18c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:26:47.737 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:47.725+0000 7f5188ea18c0 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-17T11:26:47.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:684: run_osd: wait_for_osd up 3 2026-02-17T11:26:47.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: local state=up 2026-02-17T11:26:47.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: local id=3 2026-02-17T11:26:47.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:981: wait_for_osd: status=1 2026-02-17T11:26:47.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i=0 )) 2026-02-17T11:26:47.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:47.918 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 0 2026-02-17T11:26:47.919 INFO:tasks.workunit.client.0.trial148.stdout:0 2026-02-17T11:26:47.919 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:47.919 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T11:26:48.120 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:49.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:49.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:49.121 INFO:tasks.workunit.client.0.trial148.stdout:1 2026-02-17T11:26:49.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 1 2026-02-17T11:26:49.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:49.121 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T11:26:49.316 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:50.001 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:49.989+0000 7f5188ea18c0 -1 Falling back to public interface 2026-02-17T11:26:50.318 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:50.318 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:50.318 INFO:tasks.workunit.client.0.trial148.stdout:2 2026-02-17T11:26:50.319 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 2 2026-02-17T11:26:50.319 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:50.319 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T11:26:50.520 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:51.521 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:51.521 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:51.521 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 3 2026-02-17T11:26:51.521 INFO:tasks.workunit.client.0.trial148.stdout:3 2026-02-17T11:26:51.521 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:51.521 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T11:26:51.717 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:52.718 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:52.719 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:52.719 INFO:tasks.workunit.client.0.trial148.stdout:4 2026-02-17T11:26:52.719 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 4 2026-02-17T11:26:52.720 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:52.720 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T11:26:52.914 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:53.916 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:53.916 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:53.916 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 5 2026-02-17T11:26:53.916 INFO:tasks.workunit.client.0.trial148.stdout:5 2026-02-17T11:26:53.916 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:53.916 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T11:26:54.111 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:55.112 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:55.112 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:55.113 INFO:tasks.workunit.client.0.trial148.stdout:6 2026-02-17T11:26:55.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 6 2026-02-17T11:26:55.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:55.114 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T11:26:55.307 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:985: wait_for_osd: sleep 1 2026-02-17T11:26:55.398 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:26:55.385+0000 7f5188ea18c0 -1 osd.3 0 log_to_monitors true 2026-02-17T11:26:56.308 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i++ )) 2026-02-17T11:26:56.308 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: (( i < 300 )) 2026-02-17T11:26:56.309 INFO:tasks.workunit.client.0.trial148.stdout:7 2026-02-17T11:26:56.309 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:983: wait_for_osd: echo 7 2026-02-17T11:26:56.310 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: ceph osd dump 2026-02-17T11:26:56.310 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:984: wait_for_osd: grep 'osd.3 up' 2026-02-17T11:26:56.505 INFO:tasks.workunit.client.0.trial148.stdout:osd.3 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/2538335114,v1:127.0.0.1:6827/2538335114] [v2:127.0.0.1:6828/2538335114,v1:127.0.0.1:6829/2538335114] exists,up 82269018-5625-4e3c-9b77-fbf80b58dd33 2026-02-17T11:26:56.506 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:987: wait_for_osd: status=0 2026-02-17T11:26:56.506 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:988: wait_for_osd: break 2026-02-17T11:26:56.507 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:991: wait_for_osd: return 0 2026-02-17T11:26:56.507 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-17T11:26:56.507 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: osd_pid3=99592 2026-02-17T11:26:56.507 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:50: TEST_bluestore: sleep 5 2026-02-17T11:27:01.509 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:52: TEST_bluestore: create_pool foo 16 2026-02-17T11:27:01.509 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:541: create_pool: ceph osd pool create foo 16 2026-02-17T11:27:01.756 INFO:tasks.workunit.client.0.trial148.stderr:pool 'foo' already exists 2026-02-17T11:27:01.766 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:542: create_pool: sleep 1 2026-02-17T11:27:02.768 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:55: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-17T11:27:02.788 INFO:tasks.workunit.client.0.trial148.stdout:hints = 1 2026-02-17T11:27:02.788 INFO:tasks.workunit.client.0.trial148.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-17T11:27:02.788 INFO:tasks.workunit.client.0.trial148.stdout:Object prefix: benchmark_data_trial148_100803 2026-02-17T11:27:02.788 INFO:tasks.workunit.client.0.trial148.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T11:27:02.788 INFO:tasks.workunit.client.0.trial148.stdout: 0 0 0 0 0 0 - 0 2026-02-17T11:27:03.788 INFO:tasks.workunit.client.0.trial148.stdout: 1 16 9293 9277 36.2353 36.2383 0.00129011 0.00172192 2026-02-17T11:27:04.788 INFO:tasks.workunit.client.0.trial148.stdout: 2 16 18605 18589 36.3038 36.375 0.00179413 0.00171921 2026-02-17T11:27:05.788 INFO:tasks.workunit.client.0.trial148.stdout: 3 16 27941 27925 36.3579 36.4688 0.00158702 0.0017172 2026-02-17T11:27:06.788 INFO:tasks.workunit.client.0.trial148.stdout: 4 15 37135 37120 36.2465 35.918 0.00164305 0.00172257 2026-02-17T11:27:07.788 INFO:tasks.workunit.client.0.trial148.stdout: 5 16 46823 46807 36.5646 37.8398 0.00251596 0.00170769 2026-02-17T11:27:08.788 INFO:tasks.workunit.client.0.trial148.stdout: 6 16 56452 56436 36.7389 37.6133 0.00156386 0.00169958 2026-02-17T11:27:09.788 INFO:tasks.workunit.client.0.trial148.stdout: 7 16 66036 66020 36.8383 37.4375 0.00196204 0.00169502 2026-02-17T11:27:10.789 INFO:tasks.workunit.client.0.trial148.stdout: 8 16 75640 75624 36.9226 37.5156 0.00143906 0.00169114 2026-02-17T11:27:11.789 INFO:tasks.workunit.client.0.trial148.stdout: 9 16 85996 85980 37.3145 40.4531 0.00180714 0.00167342 2026-02-17T11:27:12.789 INFO:tasks.workunit.client.0.trial148.stdout: 10 16 95684 95668 37.3672 37.8438 0.00194819 0.00167107 2026-02-17T11:27:13.789 INFO:tasks.workunit.client.0.trial148.stdout: 11 16 106375 106359 37.7664 41.7617 0.00138305 0.00165342 2026-02-17T11:27:14.789 INFO:tasks.workunit.client.0.trial148.stdout: 12 16 116708 116692 37.9825 40.3633 0.00152394 0.00164402 2026-02-17T11:27:15.789 INFO:tasks.workunit.client.0.trial148.stdout: 13 16 126980 126964 38.1471 40.125 0.00141334 0.00163691 2026-02-17T11:27:16.789 INFO:tasks.workunit.client.0.trial148.stdout: 14 15 137247 137232 38.287 40.1094 0.00132097 0.00163093 2026-02-17T11:27:17.789 INFO:tasks.workunit.client.0.trial148.stdout: 15 16 146817 146801 38.2263 37.3789 0.00169996 0.0016335 2026-02-17T11:27:18.789 INFO:tasks.workunit.client.0.trial148.stdout: 16 16 155735 155719 38.0142 34.8359 0.00168484 0.00164264 2026-02-17T11:27:19.789 INFO:tasks.workunit.client.0.trial148.stdout: 17 16 164391 164375 37.7669 33.8125 0.00158206 0.0016534 2026-02-17T11:27:20.790 INFO:tasks.workunit.client.0.trial148.stdout: 18 16 173460 173444 37.6367 35.4258 0.00167637 0.00165912 2026-02-17T11:27:21.790 INFO:tasks.workunit.client.0.trial148.stdout: 19 16 181912 181896 37.3933 33.0156 0.00140133 0.00166993 2026-02-17T11:27:22.790 INFO:tasks.workunit.client.0.trial148.stdout:2026-02-17T11:27:22.780950+0000 min lat: 0.000625724 max lat: 0.0103003 avg lat: 0.00167531 2026-02-17T11:27:22.790 INFO:tasks.workunit.client.0.trial148.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-17T11:27:22.790 INFO:tasks.workunit.client.0.trial148.stdout: 20 16 190874 190858 37.2739 35.0078 0.00168573 0.00167531 2026-02-17T11:27:23.790 INFO:tasks.workunit.client.0.trial148.stdout: 21 16 200028 200012 37.2016 35.7578 0.00222721 0.00167856 2026-02-17T11:27:24.790 INFO:tasks.workunit.client.0.trial148.stdout: 22 16 208473 208457 37.0099 32.9883 0.00243232 0.00168723 2026-02-17T11:27:25.790 INFO:tasks.workunit.client.0.trial148.stdout: 23 16 217416 217400 36.9196 34.9336 0.00190527 0.00169137 2026-02-17T11:27:26.790 INFO:tasks.workunit.client.0.trial148.stdout: 24 16 225819 225803 36.7488 32.8242 0.00230118 0.00169928 2026-02-17T11:27:27.790 INFO:tasks.workunit.client.0.trial148.stdout: 25 16 234995 234979 36.7125 35.8438 0.00125728 0.00170097 2026-02-17T11:27:28.791 INFO:tasks.workunit.client.0.trial148.stdout: 26 16 244131 244115 36.673 35.6875 0.00243622 0.00170279 2026-02-17T11:27:29.791 INFO:tasks.workunit.client.0.trial148.stdout: 27 16 253068 253052 36.6076 34.9102 0.00160093 0.00170583 2026-02-17T11:27:30.791 INFO:tasks.workunit.client.0.trial148.stdout: 28 16 259074 259058 36.138 23.4609 0.0479899 0.00172577 2026-02-17T11:27:31.791 INFO:tasks.workunit.client.0.trial148.stdout: 29 16 265217 265201 35.7192 23.9961 0.00271085 0.00174829 2026-02-17T11:27:32.791 INFO:tasks.workunit.client.0.trial148.stdout: 30 16 268327 268311 34.9335 12.1484 0.0637362 0.00178428 2026-02-17T11:27:33.791 INFO:tasks.workunit.client.0.trial148.stdout:Total time run: 30.0783 2026-02-17T11:27:33.791 INFO:tasks.workunit.client.0.trial148.stdout:Total writes made: 268327 2026-02-17T11:27:33.791 INFO:tasks.workunit.client.0.trial148.stdout:Write size: 4096 2026-02-17T11:27:33.791 INFO:tasks.workunit.client.0.trial148.stdout:Object size: 4096 2026-02-17T11:27:33.791 INFO:tasks.workunit.client.0.trial148.stdout:Bandwidth (MB/sec): 34.8475 2026-02-17T11:27:33.791 INFO:tasks.workunit.client.0.trial148.stdout:Stddev Bandwidth: 5.86146 2026-02-17T11:27:33.791 INFO:tasks.workunit.client.0.trial148.stdout:Max bandwidth (MB/sec): 41.7617 2026-02-17T11:27:33.791 INFO:tasks.workunit.client.0.trial148.stdout:Min bandwidth (MB/sec): 12.1484 2026-02-17T11:27:33.791 INFO:tasks.workunit.client.0.trial148.stdout:Average IOPS: 8920 2026-02-17T11:27:33.791 INFO:tasks.workunit.client.0.trial148.stdout:Stddev IOPS: 1500.53 2026-02-17T11:27:33.792 INFO:tasks.workunit.client.0.trial148.stdout:Max IOPS: 10691 2026-02-17T11:27:33.792 INFO:tasks.workunit.client.0.trial148.stdout:Min IOPS: 3110 2026-02-17T11:27:33.792 INFO:tasks.workunit.client.0.trial148.stdout:Average Latency(s): 0.00178999 2026-02-17T11:27:33.792 INFO:tasks.workunit.client.0.trial148.stdout:Stddev Latency(s): 0.00298605 2026-02-17T11:27:33.792 INFO:tasks.workunit.client.0.trial148.stdout:Max latency(s): 0.30087 2026-02-17T11:27:33.792 INFO:tasks.workunit.client.0.trial148.stdout:Min latency(s): 0.000625724 2026-02-17T11:27:34.302 INFO:tasks.workunit.client.0.trial148.stdout:after bench 2026-02-17T11:27:34.303 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:57: TEST_bluestore: echo 'after bench' 2026-02-17T11:27:34.303 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 92535 2026-02-17T11:27:34.303 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: sleep 1 2026-02-17T11:27:35.303 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 92535 2026-02-17T11:27:35.304 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: sleep 1 2026-02-17T11:27:36.306 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 92535 2026-02-17T11:27:36.307 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 60: kill: (92535) - No such process 2026-02-17T11:27:36.307 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:61: TEST_bluestore: ceph osd down 0 2026-02-17T11:27:37.047 INFO:tasks.workunit.client.0.trial148.stderr:osd.0 is already down. 2026-02-17T11:27:37.057 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 94824 2026-02-17T11:27:37.057 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: sleep 1 2026-02-17T11:27:38.059 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 94824 2026-02-17T11:27:38.059 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: sleep 1 2026-02-17T11:27:39.061 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 94824 2026-02-17T11:27:39.061 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 62: kill: (94824) - No such process 2026-02-17T11:27:39.061 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:63: TEST_bluestore: ceph osd down 1 2026-02-17T11:27:39.867 INFO:tasks.workunit.client.0.trial148.stderr:osd.1 is already down. 2026-02-17T11:27:39.879 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 97317 2026-02-17T11:27:39.879 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: sleep 1 2026-02-17T11:27:40.881 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 97317 2026-02-17T11:27:40.882 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: sleep 1 2026-02-17T11:27:41.883 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 97317 2026-02-17T11:27:41.884 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 64: kill: (97317) - No such process 2026-02-17T11:27:41.884 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:65: TEST_bluestore: ceph osd down 2 2026-02-17T11:27:42.083 INFO:tasks.workunit.client.0.trial148.stderr:osd.2 is already down. 2026-02-17T11:27:42.092 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 99592 2026-02-17T11:27:42.092 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: sleep 1 2026-02-17T11:27:43.092 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 99592 2026-02-17T11:27:43.093 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 66: kill: (99592) - No such process 2026-02-17T11:27:43.093 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:67: TEST_bluestore: ceph osd down 3 2026-02-17T11:27:43.342 INFO:tasks.workunit.client.0.trial148.stderr:osd.3 is already down. 2026-02-17T11:27:43.353 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:70: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-17T11:27:47.984 INFO:tasks.workunit.client.0.trial148.stdout:fsck success 2026-02-17T11:27:48.023 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:71: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-17T11:27:52.636 INFO:tasks.workunit.client.0.trial148.stdout:fsck success 2026-02-17T11:27:52.675 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:72: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-17T11:27:56.804 INFO:tasks.workunit.client.0.trial148.stdout:fsck success 2026-02-17T11:27:56.843 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:73: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-17T11:28:00.957 INFO:tasks.workunit.client.0.trial148.stdout:fsck success 2026-02-17T11:28:00.995 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:75: TEST_bluestore: truncate td/osd-bluefs-volume-ops/0/block -s 4294967296 2026-02-17T11:28:00.997 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:76: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand 2026-02-17T11:28:01.013 INFO:tasks.workunit.client.0.trial148.stdout:inferring bluefs devices from bluestore path 2026-02-17T11:28:03.920 INFO:tasks.workunit.client.0.trial148.stdout:0 : device size 0x20000000(512 MiB) : using 0x16700000(359 MiB) 2026-02-17T11:28:03.920 INFO:tasks.workunit.client.0.trial148.stdout:1 : device size 0x40000000(1 GiB) : using 0xe00000(14 MiB) 2026-02-17T11:28:03.920 INFO:tasks.workunit.client.0.trial148.stdout:2 : device size 0x100000000(4 GiB) : using 0x3118d000(786 MiB) 2026-02-17T11:28:03.920 INFO:tasks.workunit.client.0.trial148.stdout:Expanding DB/WAL... 2026-02-17T11:28:03.920 INFO:tasks.workunit.client.0.trial148.stdout:0 : nothing to do, skipped 2026-02-17T11:28:03.921 INFO:tasks.workunit.client.0.trial148.stdout:1 : nothing to do, skipped 2026-02-17T11:28:03.921 INFO:tasks.workunit.client.0.trial148.stdout:2 : Expanding to 0x100000000(4 GiB) 2026-02-17T11:28:03.921 INFO:tasks.workunit.client.0.trial148.stdout:2 : size updated to 0x100000000(4 GiB) 2026-02-17T11:28:05.930 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:28:05.915+0000 7fa14f477bc0 -1 AvlAllocator _add_to_tree inconsistent tree state 0x80000000~80000000 2026-02-17T11:28:05.930 INFO:tasks.workunit.client.0.trial148.stderr:./src/os/bluestore/AvlAllocator.cc: In function 'virtual void AvlAllocator::_add_to_tree(uint64_t, uint64_t)' thread 7fa14f477bc0 time 2026-02-17T11:28:05.919874+0000 2026-02-17T11:28:05.930 INFO:tasks.workunit.client.0.trial148.stderr:./src/os/bluestore/AvlAllocator.cc: 115: FAILED ceph_assert(rs_before == range_tree.end() || rs_before->end <= start) 2026-02-17T11:28:05.930 INFO:tasks.workunit.client.0.trial148.stderr: ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable) 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x11e) [0x7fa150d2af7a] 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18512f) [0x7fa150d2b12f] 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 3: (AvlAllocator::_add_to_tree(unsigned long, unsigned long)+0x695) [0x55efd358af35] 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 4: (AvlAllocator::init_add_free(unsigned long, unsigned long)+0x9e) [0x55efd359342e] 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 5: (BlueStore::_init_alloc(std::map, std::allocator > >*)+0x738) [0x55efd3460c48] 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 6: (BlueStore::_open_db_and_around(bool, bool)+0x3c0) [0x55efd34678c0] 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 7: (BlueStore::expand_devices(std::ostream&)+0xa4c) [0x55efd34711cc] 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 8: main() 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa150668d90] 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 10: __libc_start_main() 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 11: _start() 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:28:05.915+0000 7fa14f477bc0 -1 ./src/os/bluestore/AvlAllocator.cc: In function 'virtual void AvlAllocator::_add_to_tree(uint64_t, uint64_t)' thread 7fa14f477bc0 time 2026-02-17T11:28:05.919874+0000 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr:./src/os/bluestore/AvlAllocator.cc: 115: FAILED ceph_assert(rs_before == range_tree.end() || rs_before->end <= start) 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable) 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x11e) [0x7fa150d2af7a] 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18512f) [0x7fa150d2b12f] 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 3: (AvlAllocator::_add_to_tree(unsigned long, unsigned long)+0x695) [0x55efd358af35] 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 4: (AvlAllocator::init_add_free(unsigned long, unsigned long)+0x9e) [0x55efd359342e] 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 5: (BlueStore::_init_alloc(std::map, std::allocator > >*)+0x738) [0x55efd3460c48] 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 6: (BlueStore::_open_db_and_around(bool, bool)+0x3c0) [0x55efd34678c0] 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 7: (BlueStore::expand_devices(std::ostream&)+0xa4c) [0x55efd34711cc] 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 8: main() 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa150668d90] 2026-02-17T11:28:05.931 INFO:tasks.workunit.client.0.trial148.stderr: 10: __libc_start_main() 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 11: _start() 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr:*** Caught signal (Aborted) ** 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: in thread 7fa14f477bc0 thread_name:ceph-bluestore- 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable) 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa150681520] 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 2: pthread_kill() 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 3: raise() 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 4: abort() 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x178) [0x7fa150d2afd4] 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18512f) [0x7fa150d2b12f] 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 7: (AvlAllocator::_add_to_tree(unsigned long, unsigned long)+0x695) [0x55efd358af35] 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 8: (AvlAllocator::init_add_free(unsigned long, unsigned long)+0x9e) [0x55efd359342e] 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 9: (BlueStore::_init_alloc(std::map, std::allocator > >*)+0x738) [0x55efd3460c48] 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 10: (BlueStore::_open_db_and_around(bool, bool)+0x3c0) [0x55efd34678c0] 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 11: (BlueStore::expand_devices(std::ostream&)+0xa4c) [0x55efd34711cc] 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 12: main() 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa150668d90] 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 14: __libc_start_main() 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 15: _start() 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr:2026-02-17T11:28:05.915+0000 7fa14f477bc0 -1 *** Caught signal (Aborted) ** 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: in thread 7fa14f477bc0 thread_name:ceph-bluestore- 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable) 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa150681520] 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 2: pthread_kill() 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 3: raise() 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 4: abort() 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x178) [0x7fa150d2afd4] 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18512f) [0x7fa150d2b12f] 2026-02-17T11:28:05.932 INFO:tasks.workunit.client.0.trial148.stderr: 7: (AvlAllocator::_add_to_tree(unsigned long, unsigned long)+0x695) [0x55efd358af35] 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: 8: (AvlAllocator::init_add_free(unsigned long, unsigned long)+0x9e) [0x55efd359342e] 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: 9: (BlueStore::_init_alloc(std::map, std::allocator > >*)+0x738) [0x55efd3460c48] 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: 10: (BlueStore::_open_db_and_around(bool, bool)+0x3c0) [0x55efd34678c0] 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: 11: (BlueStore::expand_devices(std::ostream&)+0xa4c) [0x55efd34711cc] 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: 12: main() 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa150668d90] 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: 14: __libc_start_main() 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: 15: _start() 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: -499> 2026-02-17T11:28:05.915+0000 7fa14f477bc0 -1 AvlAllocator _add_to_tree inconsistent tree state 0x80000000~80000000 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: -498> 2026-02-17T11:28:05.915+0000 7fa14f477bc0 -1 ./src/os/bluestore/AvlAllocator.cc: In function 'virtual void AvlAllocator::_add_to_tree(uint64_t, uint64_t)' thread 7fa14f477bc0 time 2026-02-17T11:28:05.919874+0000 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr:./src/os/bluestore/AvlAllocator.cc: 115: FAILED ceph_assert(rs_before == range_tree.end() || rs_before->end <= start) 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable) 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x11e) [0x7fa150d2af7a] 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18512f) [0x7fa150d2b12f] 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: 3: (AvlAllocator::_add_to_tree(unsigned long, unsigned long)+0x695) [0x55efd358af35] 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: 4: (AvlAllocator::init_add_free(unsigned long, unsigned long)+0x9e) [0x55efd359342e] 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: 5: (BlueStore::_init_alloc(std::map, std::allocator > >*)+0x738) [0x55efd3460c48] 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: 6: (BlueStore::_open_db_and_around(bool, bool)+0x3c0) [0x55efd34678c0] 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: 7: (BlueStore::expand_devices(std::ostream&)+0xa4c) [0x55efd34711cc] 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: 8: main() 2026-02-17T11:28:05.933 INFO:tasks.workunit.client.0.trial148.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa150668d90] 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 10: __libc_start_main() 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 11: _start() 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: -497> 2026-02-17T11:28:05.915+0000 7fa14f477bc0 -1 *** Caught signal (Aborted) ** 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: in thread 7fa14f477bc0 thread_name:ceph-bluestore- 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable) 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa150681520] 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 2: pthread_kill() 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 3: raise() 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 4: abort() 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x178) [0x7fa150d2afd4] 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18512f) [0x7fa150d2b12f] 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 7: (AvlAllocator::_add_to_tree(unsigned long, unsigned long)+0x695) [0x55efd358af35] 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 8: (AvlAllocator::init_add_free(unsigned long, unsigned long)+0x9e) [0x55efd359342e] 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 9: (BlueStore::_init_alloc(std::map, std::allocator > >*)+0x738) [0x55efd3460c48] 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 10: (BlueStore::_open_db_and_around(bool, bool)+0x3c0) [0x55efd34678c0] 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 11: (BlueStore::expand_devices(std::ostream&)+0xa4c) [0x55efd34711cc] 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 12: main() 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa150668d90] 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 14: __libc_start_main() 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 15: _start() 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2026-02-17T11:28:05.934 INFO:tasks.workunit.client.0.trial148.stderr: 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: -499> 2026-02-17T11:28:05.915+0000 7fa14f477bc0 -1 AvlAllocator _add_to_tree inconsistent tree state 0x80000000~80000000 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: -498> 2026-02-17T11:28:05.915+0000 7fa14f477bc0 -1 ./src/os/bluestore/AvlAllocator.cc: In function 'virtual void AvlAllocator::_add_to_tree(uint64_t, uint64_t)' thread 7fa14f477bc0 time 2026-02-17T11:28:05.919874+0000 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr:./src/os/bluestore/AvlAllocator.cc: 115: FAILED ceph_assert(rs_before == range_tree.end() || rs_before->end <= start) 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable) 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x11e) [0x7fa150d2af7a] 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18512f) [0x7fa150d2b12f] 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: 3: (AvlAllocator::_add_to_tree(unsigned long, unsigned long)+0x695) [0x55efd358af35] 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: 4: (AvlAllocator::init_add_free(unsigned long, unsigned long)+0x9e) [0x55efd359342e] 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: 5: (BlueStore::_init_alloc(std::map, std::allocator > >*)+0x738) [0x55efd3460c48] 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: 6: (BlueStore::_open_db_and_around(bool, bool)+0x3c0) [0x55efd34678c0] 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: 7: (BlueStore::expand_devices(std::ostream&)+0xa4c) [0x55efd34711cc] 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: 8: main() 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: 9: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa150668d90] 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: 10: __libc_start_main() 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: 11: _start() 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: -497> 2026-02-17T11:28:05.915+0000 7fa14f477bc0 -1 *** Caught signal (Aborted) ** 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: in thread 7fa14f477bc0 thread_name:ceph-bluestore- 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: ceph version 19.2.3-705-g04cf6dd4 (04cf6dd4be446d06026adad18a5fbf5da1fa8c0e) squid (stable) 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fa150681520] 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: 2: pthread_kill() 2026-02-17T11:28:05.935 INFO:tasks.workunit.client.0.trial148.stderr: 3: raise() 2026-02-17T11:28:05.936 INFO:tasks.workunit.client.0.trial148.stderr: 4: abort() 2026-02-17T11:28:05.936 INFO:tasks.workunit.client.0.trial148.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x178) [0x7fa150d2afd4] 2026-02-17T11:28:05.936 INFO:tasks.workunit.client.0.trial148.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18512f) [0x7fa150d2b12f] 2026-02-17T11:28:05.936 INFO:tasks.workunit.client.0.trial148.stderr: 7: (AvlAllocator::_add_to_tree(unsigned long, unsigned long)+0x695) [0x55efd358af35] 2026-02-17T11:28:05.936 INFO:tasks.workunit.client.0.trial148.stderr: 8: (AvlAllocator::init_add_free(unsigned long, unsigned long)+0x9e) [0x55efd359342e] 2026-02-17T11:28:05.936 INFO:tasks.workunit.client.0.trial148.stderr: 9: (BlueStore::_init_alloc(std::map, std::allocator > >*)+0x738) [0x55efd3460c48] 2026-02-17T11:28:05.936 INFO:tasks.workunit.client.0.trial148.stderr: 10: (BlueStore::_open_db_and_around(bool, bool)+0x3c0) [0x55efd34678c0] 2026-02-17T11:28:05.936 INFO:tasks.workunit.client.0.trial148.stderr: 11: (BlueStore::expand_devices(std::ostream&)+0xa4c) [0x55efd34711cc] 2026-02-17T11:28:05.936 INFO:tasks.workunit.client.0.trial148.stderr: 12: main() 2026-02-17T11:28:05.936 INFO:tasks.workunit.client.0.trial148.stderr: 13: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fa150668d90] 2026-02-17T11:28:05.936 INFO:tasks.workunit.client.0.trial148.stderr: 14: __libc_start_main() 2026-02-17T11:28:05.936 INFO:tasks.workunit.client.0.trial148.stderr: 15: _start() 2026-02-17T11:28:05.936 INFO:tasks.workunit.client.0.trial148.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2026-02-17T11:28:05.936 INFO:tasks.workunit.client.0.trial148.stderr: 2026-02-17T11:28:06.319 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 19: 102432 Aborted (core dumped) ceph-bluestore-tool --path $dir/0 bluefs-bdev-expand 2026-02-17T11:28:06.319 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:76: TEST_bluestore: return 1 2026-02-17T11:28:06.319 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: return 1 2026-02-17T11:28:06.320 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2379: main: code=1 2026-02-17T11:28:06.320 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: main: teardown td/osd-bluefs-volume-ops 1 2026-02-17T11:28:06.320 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:164: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-17T11:28:06.320 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: local dumplogs=1 2026-02-17T11:28:06.320 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:166: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-17T11:28:06.320 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: shopt -q -o xtrace 2026-02-17T11:28:06.321 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: echo true 2026-02-17T11:28:06.321 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:345: kill_daemons: local trace=true 2026-02-17T11:28:06.321 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: true 2026-02-17T11:28:06.321 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:346: kill_daemons: shopt -u -o xtrace 2026-02-17T11:28:06.430 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:362: kill_daemons: return 0 2026-02-17T11:28:06.431 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: uname 2026-02-17T11:28:06.432 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:167: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-17T11:28:06.432 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: stat -f -c %T . 2026-02-17T11:28:06.433 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:168: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-17T11:28:06.433 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: local cores=no 2026-02-17T11:28:06.434 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: sysctl -n kernel.core_pattern 2026-02-17T11:28:06.435 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:172: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:28:06.435 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:174: teardown: '[' / = '|' ']' 2026-02-17T11:28:06.435 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: grep -q '^core\|core$' 2026-02-17T11:28:06.436 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T11:28:06.437 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:28:06.438 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:181: teardown: cores=yes 2026-02-17T11:28:06.438 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:182: teardown: '[' -n '' ']' 2026-02-17T11:28:06.438 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: '[' yes = yes -o 1 = 1 ']' 2026-02-17T11:28:06.438 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: '[' -n '' ']' 2026-02-17T11:28:06.438 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:194: teardown: mkdir -p /home/ubuntu/cephtest/archive/log 2026-02-17T11:28:06.439 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:195: teardown: mv td/osd-bluefs-volume-ops/mgr.x.log td/osd-bluefs-volume-ops/mon.a.log td/osd-bluefs-volume-ops/osd.0.log td/osd-bluefs-volume-ops/osd.1.log td/osd-bluefs-volume-ops/osd.2.log td/osd-bluefs-volume-ops/osd.3.log /home/ubuntu/cephtest/archive/log 2026-02-17T11:28:06.440 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-17T11:28:06.583 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: get_asok_dir 2026-02-17T11:28:06.583 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_dir: '[' -n '' ']' 2026-02-17T11:28:06.583 INFO:tasks.workunit.client.0.trial148.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_dir: echo /tmp/ceph-asok.91057 2026-02-17T11:28:06.583 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:199: teardown: rm -rf /tmp/ceph-asok.91057 2026-02-17T11:28:06.584 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:200: teardown: '[' yes = yes ']' 2026-02-17T11:28:06.584 INFO:tasks.workunit.client.0.trial148.stdout:ERROR: Failure due to cores found 2026-02-17T11:28:06.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:28:06.586 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:201: teardown: echo 'ERROR: Failure due to cores found' 2026-02-17T11:28:06.586 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:202: teardown: '[' -n '' ']' 2026-02-17T11:28:06.586 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:205: teardown: return 1 2026-02-17T11:28:06.586 INFO:tasks.workunit.client.0.trial148.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2381: main: return 1 2026-02-17T11:28:06.586 INFO:tasks.workunit:Stopping ['osd'] on client.0... 2026-02-17T11:28:06.587 DEBUG:teuthology.orchestra.run.trial148:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-17T11:28:06.934 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/workunit.py", line 144, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/workunit.py", line 292, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_04cf6dd4be446d06026adad18a5fbf5da1fa8c0e/qa/tasks/workunit.py", line 433, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/remote.py", line 596, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial148 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh' 2026-02-17T11:28:06.939 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T11:28:06.953 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T11:28:06.954 DEBUG:teuthology.orchestra.run.trial148:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T11:28:07.045 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T11:28:07.056 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T11:28:07.056 DEBUG:teuthology.orchestra.run.trial148:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T11:28:07.461 INFO:teuthology.orchestra.run.trial148.stdout: remote refid st t when poll reach delay offset jitter 2026-02-17T11:28:07.461 INFO:teuthology.orchestra.run.trial148.stdout:============================================================================== 2026-02-17T11:28:07.462 INFO:teuthology.orchestra.run.trial148.stdout:*ntp2.zeus.frume 209.180.247.49 2 u 15 64 377 29.706 +6.150 2.940 2026-02-17T11:28:07.462 INFO:teuthology.orchestra.run.trial148.stdout:+192-155-94-72.i 130.207.244.240 2 u 1 64 377 19.773 +8.186 3.596 2026-02-17T11:28:07.462 INFO:teuthology.orchestra.run.trial148.stdout:+149.28.61.105 ( 45.63.54.13 3 u 17 64 377 3.365 +1.701 4.639 2026-02-17T11:28:07.462 INFO:teuthology.orchestra.run.trial148.stdout:-69-10-208-170.r 128.9.176.30 2 u 28 64 377 65.221 +8.564 3.828 2026-02-17T11:28:07.462 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T11:28:07.477 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T11:28:07.477 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T11:28:07.493 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T11:28:07.508 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T11:28:07.523 INFO:teuthology.task.internal:Duration was 1094.587028 seconds 2026-02-17T11:28:07.523 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T11:28:07.537 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T11:28:07.537 DEBUG:teuthology.orchestra.run.trial148:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T11:28:07.564 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T11:28:07.564 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial148.front.sepia.ceph.com 2026-02-17T11:28:07.565 DEBUG:teuthology.orchestra.run.trial148:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T11:28:07.614 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T11:28:07.614 DEBUG:teuthology.orchestra.run.trial148:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T11:28:07.808 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T11:28:07.808 DEBUG:teuthology.orchestra.run.trial148:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T11:28:07.817 INFO:teuthology.orchestra.run.trial148.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T11:28:07.818 INFO:teuthology.orchestra.run.trial148.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T11:28:07.818 INFO:teuthology.orchestra.run.trial148.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T11:28:07.818 INFO:teuthology.orchestra.run.trial148.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T11:28:07.818 INFO:teuthology.orchestra.run.trial148.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T11:28:07.866 INFO:teuthology.orchestra.run.trial148.stderr: 81.7% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T11:28:07.867 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T11:28:07.884 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T11:28:07.884 DEBUG:teuthology.orchestra.run.trial148:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T11:28:07.917 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T11:28:07.934 DEBUG:teuthology.orchestra.run.trial148:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:28:07.967 INFO:teuthology.orchestra.run.trial148.stdout:kernel.core_pattern = core 2026-02-17T11:28:07.980 DEBUG:teuthology.orchestra.run.trial148:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T11:28:08.023 WARNING:teuthology.task.internal:Found coredumps on ubuntu@trial148.front.sepia.ceph.com, flagging run as failed 2026-02-17T11:28:08.024 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T11:28:08.041 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T11:28:08.043 DEBUG:teuthology.misc:Transferring archived files from trial148:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51269/remote/trial148 2026-02-17T11:28:08.044 DEBUG:teuthology.orchestra.run.trial148:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T11:32:43.290 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2026-02-17T11:32:43.309 INFO:teuthology.task.internal: core looks like: /home/teuthworker/mnt/teuthology/skanta-2026-02-17_04:03:08-rados-wip-bharath19-testing-2026-02-13-0903-squid-distro-default-trial/51269/remote/trial148/coredump/1771327685.102432.core.gz: gzip compressed data, was "1771327685.102432.core", last modified: Tue Feb 17 11:28:08 2026, max compression, original size modulo 2^32 360980480 2026-02-17T11:32:43.309 INFO:teuthology.task.internal:core is compressed, try accessing gzip file ... 2026-02-17T11:32:43.912 INFO:teuthology.task.internal: core looks like: /tmp/tmp13ri2dfx: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand', real uid: 1000, effective uid: 1000, real gid: 1002, effective gid: 1002, execfn: '/usr/bin/ceph-bluestore-tool', platform: 'x86_64' 2026-02-17T11:32:43.917 INFO:teuthology.task.internal: dump_program: ceph-bluestore-tool 2026-02-17T11:32:43.917 DEBUG:teuthology.orchestra.run.trial148:> which ceph-bluestore-tool 2026-02-17T11:32:43.922 INFO:teuthology.orchestra.run.trial148.stdout:/usr/bin/ceph-bluestore-tool 2026-02-17T11:32:43.966 DEBUG:teuthology.orchestra.remote:trial148:/usr/bin/ceph-bluestore-tool is 10MB 2026-02-17T11:32:44.112 DEBUG:teuthology.orchestra.run.trial148:> mktemp 2026-02-17T11:32:44.116 INFO:teuthology.orchestra.run.trial148.stdout:/tmp/tmp.6t7XQwqURh 2026-02-17T11:32:44.117 DEBUG:teuthology.orchestra.run.trial148:> sudo cp /usr/bin/ceph-bluestore-tool /tmp/tmp.6t7XQwqURh 2026-02-17T11:32:44.178 DEBUG:teuthology.orchestra.run.trial148:> sudo chmod 0666 /tmp/tmp.6t7XQwqURh 2026-02-17T11:32:44.275 DEBUG:teuthology.orchestra.remote:trial148:/tmp/tmp.6t7XQwqURh is 10MB 2026-02-17T11:32:44.426 DEBUG:teuthology.orchestra.run.trial148:> rm -fr /tmp/tmp.6t7XQwqURh 2026-02-17T11:32:44.434 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T11:32:44.434 DEBUG:teuthology.orchestra.run.trial148:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T11:32:45.946 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T11:32:45.959 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T11:32:45.959 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T11:32:45.977 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T11:32:45.977 DEBUG:teuthology.orchestra.run.trial148:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T11:32:45.983 INFO:teuthology.orchestra.run.trial148.stdout: 1180220 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 17 11:32 /home/ubuntu/cephtest 2026-02-17T11:32:45.983 INFO:teuthology.orchestra.run.trial148.stdout: 1190266 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 17 11:12 /home/ubuntu/cephtest/mnt.0 2026-02-17T11:32:45.983 INFO:teuthology.orchestra.run.trial148.stdout: 1190267 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 17 11:25 /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T11:32:45.983 INFO:teuthology.orchestra.run.trial148.stdout: 1205017 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 17 11:25 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T11:32:45.983 INFO:teuthology.orchestra.run.trial148.stdout: 1205018 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Feb 17 11:28 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td 2026-02-17T11:32:45.984 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T11:32:45.984 INFO:teuthology.orchestra.run.trial148.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-17T11:32:45.985 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_fa17720d0088c3ac28e473468bfc79eeaff5cd38/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial148 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-17T11:32:45.987 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T11:32:45.998 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T11:32:46.012 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on trial148 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-17T11:32:46.015 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} duration: 1094.5870282649994 failure_reason: 'Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial148 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=04cf6dd4be446d06026adad18a5fbf5da1fa8c0e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh''' flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-17T11:32:46.015 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T11:32:46.112 INFO:teuthology.run:FAIL